


CHAPTER II 

TABULATION AND CLASSIFICATION 

MMaaios a nd variables . The many types of data decdt 
^ statistical work are frequently grouped into two chief 
varieties: attributes and variables. The former, attributes or 
unordered characteristics, may be defined as those not expressed 
in numencal terms, whereas variables, or ordered characteristics, 
are expressed m numerical terms. The division of data dealt 
with by the method of attributes is most often twofold, but it 
may comprise three or more groups. For example, school puinls 
are frequently classified as boys or girls, or as elementary or 
high-echool pupils; the various colors of hair are frequently 
grouped into three classes: dark, light, and red; high-school 
pupils are often classified accordmg to the subjefcts they have 
carried, the resultant tables showing how many pupUs are en- 
rolled in English, how many in Latin, how many in algebra, 
and so on through the various subjects. In the cases cited and 
other similar ones there is no satisfactory way of describing or 
indicating the various groups or classes or the differences be-^ 
tween them in numerical terma A certain number on a sex 
scale does not represent boys and another number girls, nor a 
certain number on a subject scale represent Enghsh, another 
Latin, another algebra, and so on. As will appear later ha 
various connections, data such as these do not lend themselvee 
readily to many of the statistical procedures more or leas cena- 
monly applied to those of the other type. A majority of the 
statistical methods and procedures employed have been devised 
with variables or ordered characteristics in mmd and are suited 
to them rather than to attribute or unordered characteristics. 

Most of the data dealt with in educational work are variables. 
I^upils’ scores upon tests, their daily marks, their ages, teachers’ 
salanes, scores given school buildings and their equipment and 
a host of other items are not only susceptible of numen%»i ex- 
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.04, .07, and .033, all positive, respectively. How does it compan witti' 
that pr^cted by the rule on page 10? 

4. Do the same for factors of 2.01, 1.47, 5.608, 8.08, and 3.94, 
absolute errors of +.01, —.03, +.108, +.08, and —.06, rrapecti 

5. Determine by actual calculation the relative error in each in- 

dicated power or root, and compare it with that found by the fornwla 
on pages 10-1 1 : A. (102)’, absolute error +2, B. (3.535)’, absolute Airor 
+.035; C. v^l6 0801, absolute error + 0801, D. (3.94)’, abs^^UBjWror 
— .06, E. >yi5.68239201, absolute error —.31760799. ‘ 

6. What does each of the followmg become if changed to a two- 
place decimal? A. 4.1962, B. .0450, C. 2.93499, D. 104.273, E. .1545, 
F. 7.14444, G. 5.24937, H. 25 004. 

7. What is the correct quotient to three places, of each of the follow- 
ing? A. 1. + 80.; B. 5. + .7, C. 60. -r 11.; D. 312.56 + 48. 
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PREFACE 


In the preparation of this volume the author has been guided 
by the same general purposes and pomts of view as in the pro- 
duction of his Educational Statistics. It is designed to meet the 
statistical needs of those mterested in the field of education 
by presenting the subject m a manner as non-mathematical 
possible. 

Although the number of texts in educational statistics now 
available is no longer so limited as when the former book was 
prepared, it does not seem so ^at as to indicate that there is 
not a place for an additional volume. Even though treaties 
on this subject do not go out of date so rapidly as do those on 
some others, yet enough new statistical procedures and new 
applications of old procedures are being mtroduced into educa- 
tion to render uicomplete any treatment of this tc^c that is 
several years old 

The chief change that the writer has made in this, as com- 
pared with his Educational Statistics, is of tibe sort referred to 
in the preceding paragraph, the addition of a number of new 
topics, formulie, references, and so forth. This, however, is not 
the only point in which hn hM\endeavored to improve the 
previous text. Through expuffil^in using it in his classes, he 
has detected certain weak points^ and believes that be has been 
able to strengthen these. By the inclusion of a larger numbo' 
of references, the volume has been given greater val^ for those 
who wish to make a more complete study of the sublet than is 
possible from it alone. Furthermore, the number of exercises futd 
problems for solution has been considerably increased. 

In preparing this volume the writer has had in mind that it 
should sdSford material for the usual first course in statisties 
and, in addition, for either a second course or for further indi- 
vidual study. In using it, different instructors will, in view of 
the different amounts of time devoted to the subject, the various 
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levels of maturity of those taking it, and their own judgments, 
naturally differ as to what portions should be used in the first 
course. For such a first course as the writer is accustomed to 
give, that is, a semester course in which ten or twelve hours per 
week of work are expected, he suggests that the following be 
covered: the major portions of Chapters I to XIII; very little 
of Chapters XIV to XVIII; considerable portions of Chap- 
ters XIX to XXII ; and most or all of Chapter XXIII. 

In connection with the preparation of such a volume as this, 
which consists of little that is original except the form of presen- 
tation, and which has been drawn from so many different 
sources, it is somewhat difiScult to decide what acknowledg- 
ments for assistance should be made Therefore the writer will 
not at this point attempt to make complete acknowledg- 
mmte of his indebtedness to the many individuals to whom 
he feels it. Insofar as this indebtedness is to the authors of 
puUidlilj^ poatenal that is not more or less common property, 
that inay not be found in several sources, it will be in- 

dicated by means of references m the text. More general 
sources wffl |if given in the bibliography in Appendix A. In 
addition to acknowledgments of the sort just referred to the 
writer wishes to express his appreciation for the assistance of 
Dr. Max D. Engelhart who criticized many portions of the 
manuscript and offered numerous suggestions. 

The lists of references given at the ends of sections in the 
earlier edition of this work are not included in the revision. 
Instead, references that seem to be (ff outstanding value, as 
containing the most helpful, most complete, or most easily 
avaUable discussions of the points being dealt vrith, are given in 
coimection with these particul^ points. No references at all 
are given for many points coma^nly treated in textbooks and 
eJsewhere. Appendix A contains a list of more or less general 
references to which the reader is referred for further discussions 

those topics that have no references accompanying them. 

C. W. Odbll 
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IN EDUCATION 




CHAPTER I 

INTRODUCTION 

Purpose of this volume. Only within the last two decades 
has the use of statistics begun to fill the important place in 
education and most other social sciences that it has long held 
in physical science and more recently occupied in biological 
science. It is now, however, generally recogmzed that a knowl- 
edge of statistical methods and procedures is a necessary quali- 
fication for the scientific study of many educational problems. 
This 18 true for at least two reasons, both of which have been 
guidmg factors in the preparation of this volume. One of the 
resultmg purposes is to fanuUanze those studying this book 
with the statistical methods and formute to be applied to the 
handling of educational data, to the solution of educational 
problems, and to the interpretation of the results secured. The 
second and almost equally important aim is to render under- 
standable the large number of statistical terms and references 
found m current educational discussions, both oral and written. 
Such understanding is rendered more complete by a knowledge 
of how to compute the statistical measures referred to, ||Ut it 
is possible to gam a reasonable degree thereof without possessing 
this knowledge. The reader who desires to master only this 
phase of the contents of the present treatise will in most cases 
be able to omit the other portions, which present formuhe and 
methods of computation, without seriously mterfenng with his 
purpose. ’ 

Genet# suggestions for statistical workers. There are cer- 
tain general suggestions that may with profit be followed by 
statistical workers.* Probably the first is that statistics is a 
tool rather than an end m itself. As such it should be used 

*For a fuller presentation of such suggeetions, see Ernest W. Tiegs 
and Claude C. Crawford, Statislics for Teachert (Boston, Houghton Mifflin 
Co., 1930), Ch. xii, "Principles of Statistic^ Research." 

3 
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when needed to contribute to the accomplishment of the de- 
sired ptirpose of a piece of research. With this purpose in mind 
one should plan statistical work before actually be ginning it. 
It is rarely possible to plan in full detail all that is to be done, 
but in most cases the worker ean make plans that will need 
comparatively little alteration or addition. Preparatory plan- 
ning should include consideration of the data to be handled; 
of their relation to the problems to be solved or questions to 
be answered; of their accuracy, adequacy, and representative- 
ness; of their analysis and the measures to be computed from 
of the most convenient form m which to arrange them 
fbi? computation; of the best tabular and graphic arrangement 
in case they are to be presented to others; and of other more 
or less similar pomts. 

To avoid unprofitable labor and to help to insure dependable 
results, it should be kept m mind that the data being dealt 
with need to be satisfactory with regard to both quality and 
quantity. One can rarely, if ever, derive significant findings 
from inadequate data by mere refinement of statistical tech- 
nique. Perhaps the most frequent error m this connection is 
the assumption that if the data available are numerous enough 
the results based upon them may be considered significant re- 
gardless of their quality or accuracy. Although it is true tiiat 
in some cases quantity may to a limited extent balance <|||| 
fects of quality, there are many instances in which this is .igr 
no means true, and in which mcreasing the number of data 
does not improve the accuracy of the results. 

It may seem self-evident, but apparently is not to numesous 
persons who attempt to employ statistical methods, that any- 
one working in this field should have the capacity for careful, 
thorough, and accurate work. Even though one makes large 
use of prepared tables, calculating machines, and other helps, 
he is very unlikely to be a successful statistician if he is not 
reasonably accurate in performing the ordinary operations (rf 
arithmetic. No attempt will be made in this volume to give 
explicit training along this line, but rather it will be assumed 
that anyone studying educational statistics will be sufficiently 
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self-critical to determine whether or not his arithmeticfd ability 
is satisfactory and, if not, to go through the amount of practice 
and drill necessary to make it so before he attempts to employ 
statistical procedures. 

Aids to computation. The aids to computation fall in gen- 
eral into two chief classes, tables and computing machines. 
There are available numerous tables that are useful in per- 
forming vanous arithmetical operations. Of such general tables 
Barlow's Tables of Sqtuires, Cvbes, Square Roots, Cube Roots, 
and Reciprocals “ are probably the most useful to workers in 
the field of educational statistics. Multiphcation tablei^^||||ull 
as those of Crelle and Peters,* may often be employed to ISive 
much labor, especially if either multiplier or raultiphcand re- 
mains the same for a series of operations. In many cases, es- 
pecially if computmg machines are not employed, logarithmic 
tables are quite helpful, and in occasional instances trigonometric 
ones are needed. Undoubtedly the most useful tables of a less 
general nature are those prepared by Pearson for statisticians 
and biometricians.* Many of these are concerned with functions 
of the normal curce and other curves frequently employed in 
statistical work. Number II of the set is Sheppard’s Table of 
the Probability Integral, which is fundamental to many of the 
apticedures and computations employed in dealing with educa- 
^nonal data. Holzinger * has prepared a set of a dozen tables 
^at provides an excellent combination of those for geneitd 
cflttnputation and those more or less peculiar to educational 
statistics. The handbook prepared by Dunlap and Kurtz * is. 


• Barlow, Tablet of Squaret, Cubes, Square Roots, Cube Roots, Recipro- 
eals, of All Integer Numt^s up to 10,000 (London, E and F N Spon, Ltd., 
1914), 200 pp. 

•O. Seeliger, Dr A. L. Crelle’ s Calculating Tables (Berlin, Walter de 
Gruyter & Co., 1919) 

J. Peters, Neue RecherUafeln fur M ulitpltkatwn und Dtnston mtt Alien 
Ein-bis Vierslelltgen Zahlen (Berlin, Georg Renner, 1909) 

‘ Karl Pearson (Editor), Tables for Slattslicians and Btometriciane (Cam- 
bridge, Cambridge University Press, 1914), 143 pp. 

‘Karl J. Holzmger, Statistical Tables for Students in Education and 
Psychology (Chicago, University of Chicago Press, 1925), 74 pp. 

* Jack W. Dunlap and Albert K. Kurtz, Handbook of Slalittieal Namo- 
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insofax as the writer knows, the outstanding available help of 
this sort. It contains three parts, of which the first presents 
almost thirty nomographs that may be employed in computing 
results frequently desired in work in educational statistics, the 
second a dozen tables of much the same type as those found in 
Holzinger, and the third a list of over four hundred formulas 
and a large number of S3Tnbol8 employed in this field. 

There are many useful computing machines on the market. 
For thrpe-figure accuracy, a ten-inch slide rule, such as is com- 
monh^hsed by engineers, is probably the most convenient in- 
struimnt. A twenty-mch rule will give four or five places, but 
is much less convenient. One slide rule mtended particularly 
for workers in education and psychology has been devised. It 
contain^ ten standard slide-rule scales and seven especially 
planned for statistical work in the two fields named. It was 
constructed by Enlow and is described m the references given 
below.’ For more elaborate and exact work electrically driven 
machines of vanous sorts are best, although those operated by 
hand are distmctly worth employing if the more expensive 
electrical ones are not available For simple addition the Comp- 
tometer is one of the best. For both addition and multiplication 
the Burroughs is good. If there is much division to be done, 
the Marchand, the Millionaire, and the Monroe are better. For 
the elaborate classification of thousands of cases, a mechamcal 
card-punching and automatic sorting device is economical. The 
Hollerith is a widely used machine of this type, being employed 
in connection with the statistical compilations made in a number 
of our largest city school systems and elsewhere. Recently 
Warren and Mendenhall have constructed a somewhat similar 
machine which appears to have the widest range of useful- 
ness of any now available, and to accomplish a number of 
more-or-less complex operations more expeditiously than any 

graphs, Table*, and Formula* (Yonkers-oD-Hudson, World Book Com- 
pany, 1932), 163 pp. 

Remer Enlow, “A Statistical Slide Rule,” ContribnUions to 
EduaUion, No 130, Nashville, George Peabody College for Teachers, 1934. 

“An Abstract of a Statistical Shde Rule,” Peabody Jowmal of 

Education, VoL 12, July, 1934, pp. 26-30. 
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other.* For the computation of correlation and regression, Hull 
and Seashore have devised machmes that will be referred to in 
connection with those topics. 

This bnef bst of tables and mechanical devices by no means 
includes all that may be found helpful by the worker in educa- 
tional statistics, but merely shows a few that seem to the writer 
to be among the most useful. For a somewhat fuller discussion 
of aids to computation the reader is referred to Tiegs and 
Crawford * An excellent account of the construction of nomo- 
grams accompamed by the most complete bibliographyT||| the 
subject with which the wnter is familiar has been prepared Iqr 
Gnffin.*® 

Terminology and s3rmbolism. Unfortunately the terminol- 
ogy and, still more, the symbolism employed in the &ld dealt 
with by this volume are far from standardized. This fact is 
evident from studies made by West " and others. From time 
to time attempts tending toward such standardization have 
been made. Of these, that of Monroe is among the most 
recent and most comprehensive. The writer will foUow it in 
most cases, often givmg also the symbols employed by workers 
who do not confonn thereto. 

Accuracy in computation. It has already been stated that 
the worker m this field should be able to compute accurately. 
In addition to this, however, the accuracy of the data being 
dealt with must be taken mto consideration so that the degree 
of accuracy of the results obtamed therefrom can be known, 
or at least approxunated. In some cases it is possible to obtain 
data accurate to almost any desired degree. Since a higher 

• “The New Wizard, ” Teachers College Record, Vol 32, December, 1930, 
pp. 291-292. 

• Ernest W. Tiegs and Claude C. Crawford, op. ctt., Ch. ii, “Labor- 
Saving Devices and Equipment.'' 

“Harold D. Griffin, “How to Construct a Nomogram,” Journal of 
Edueaiional Psychology, Vol 23, November, 1932, pp 561-577. 

“ Paul V. West, “Need fur Standardization of Symbols and Formula 
in Educational Statistics,” Journal of Eipenmental Educodum, VoL 1, 
March, 1933, pp. 216- 222. 

‘•Walter S. Monroe, “Standardization of Statistical Symbolism,” 
Journal of Experimental Education, Vol. 1, March, 1933, pp. 223-228. 
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iJikgree of accuracy usually requires a greater amount of com- 
putation to secure it, useless labor can frequently be avoided 
Jhgr deciding upon the degree of accuracy needed m the results, 
determmmg in advance how accurate the original data 
a^fthe following computations must be. The determination 
of lijE degree of accuracy desirable in the results depends in 
part upon the type of data involved, and in part upon the pur- 
poses of the study. For example, in dealing with teachers’ an- 
nual salaries, in almost no case is it worth-while to take them 
to the nearest cent, and in most mstances not even to the nearest 

^ but perhaps to the nearest twenty-five, fifty, or even 
l^red doUars. In dealing w’lth the total expenditures of 
^1 systems, the nearest thousand or even the nearest 
ten thousand or one hundred thousand dollars is frequently 
close enough for all practical purposes In measurmg the weights 
of school children the nearest pound is conventionally taken 
as being accurate enough. In determmmg cost per pupil hour, 
however, at least the nearest cent is generally wanted and 
sometimes the nearest tenth of a cent. 

The accuracy of a number may be expressed as either absolute 
or relative. In Other words, a number may be known to be 
accurate to within a certain definite amount, or to wittun a 
oertam proportion of the number itself. For example, such a 
number as 12.9 is conventionally understood to be accurate to 
the first decimal place, that is, to the nearest tenth; one such 
as 4.183 to three places, or the nearest thousandth; and so with 
others. This means that 12.9 ls known to have a true value 
between 12.85 and 12.95 and 4.183 to havtf'one between 4.1825 
and 4.1835. Instead, however, one may state the accuracy of 
12.9 as being withm a relative error of .4 per cent, obtained by . 
dividing .05 by 12.9. Sometimes, instead of stating absolute 
accuracy in terms of the number of decimal places correct, it is 
stated by giving the number of significant figures correct, that 
is, the number of digits, omittmg any sseros that occur ahead of 
all other figures, known to be correct. Thus 12.9 would be said 
to be correct to three significant figures and 4.183 to four.** 

*' It should be observed that the position of the decimal point has noUi- 
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In dealing with accuracy it is important to remember tlM|t 
often there must be more decimal places or significant figuieB 
accurate in certain of the steps leadmg to a given result 
are accurate in the result itself. There are some 
however, in which the result may be relied on as 
more accurate than any one of the quantities that enter Into 
its determmation. A few of the most helpful rules and 
principles for determining the accuracy of the result when 
that of the quantities entering mto it is known, will be pvai 
below. 

The error in a sum or total may be as great as the ; 
the errors in the quantities added to give the total, b« 
these quantities am subject to biased or systematjjj^ 
that is, errors all m the same direction, this is unlikely to be the 
case. It IS more likely that the errors in the quantities are 
chance or unbiasc'd errors that tend to compensate one another 
so that the error in their total approximates zero. Biased errors 
may be illustrated by those caused by the use of a yardstick, 
for example, that is one-half mch too long. If the lengths of a 
number of objects are measured by such a yardstick, and added, 
the total will be m error by appro.ximately the sum of the errors 
or, in other words, by as many times <»e-half inch as the yard- 
stick has been applied. If, instead, the yardstick is of the 
correct length, the errors in the measurements of the various 
objects will probably be due to carelessness, and will sometimes 
be positive, sometimes negative, so that when added they will 
tend to balance one another and thus produce very little error 
in the sum. TJierrfore a total is usually more accurate than 
the quantities which compose it. 

From the samq considerations it follows that an average, 


log to do with the numlier of significant figures in a number. Thus, for 
example, each of the following ha.*) four significant figures. 4975., 24.56, 
1.245, .02287. It is to lie understood, unless stated otherwise, that only as 
many sigiuficant figures of a numlier are given as may lie considered accu- 
rate. For example, 12 5 would indicate that the quantity concerned is accu- 
rate to three significant figures, or, in other words, to the nearest tenth; 
12.50, that it is accurate to four significant figures or to the nearest hun- 
dredth; 12 500, that It is accurate to five figures or to the nearest thou- 
sandth, and BO on 
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|ino6 it is merely a total divided by the number of cases en- 
into it, is usually more reliable than the single measures 
contribute to it. Therefore the practice of carrying an 
a^age to more decimal places than the items that enter mto 
it is usually justified. If there are ten or more items the average 
may be carried to one more decimal place; if there are one 
hundred or more items, to two more places; if one thousand or 
more, to three more; and so on It should not be overlooked, 
however, that the error in an average may be as large as the 
average of the errors in the individual measures. This, of course, 
corre^nds to the possibility mentioned above that the error 
in a total may be the sum of the errors m the individual 
measures. 

In multiphcation and division the number of significant 
figures in tiie product or quotient known to be accurate is no 
greater thott the number of such figures in the contnbutmg 
item with tBe smallest number of accurate figures. Thus, if 
one number with six accurate figures is multiplied or divided 
by another in which only two are accurate, the resulting product 
or quotient cannot be known to be accurate to more than two. 
However, if several multiplications or divisions have been per- 
formed and the errors m the various quantities concerned have 
been unbiased or chance errors, there is the same compiensating 
tendency as in the case of addition, and it is probable that the 
result IS more accurate than the quantities entering into it. 
The approximate limit of the relative error m a product or 
quotient is the sum of the relative errors in the factors. Thus, 
for example, if a quantity with a relative error of 1 per cent is 
multiphed by another with a relative error of 2 per cent, and 
their product by another with a relative error of 4 per cent, 
the possible relative error in the final product is approximately 
7 per cent. If, however, as is probable, these relative errors 
are not all in the same direction, the error in the product will 
be much less than 7 per cent. 

Relative errors of powers and roots may be determined by 
the rule that the relative error of the nth power of any number 
is approximately n times that of the number itself, and con- 
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veraely that the relative error of the nth root of any numbet 

is approximately ^ that of the number. For example, if 

relative error of a number is .001 and it is raised to 
fifth power, the relative error of the result is about .005, 
whereas if its fifth root is taken, the relative error thereof 
is only about .0002. It is also true of square roots in general, 
although subject to some exceptions, that such a root contains 
as many significant figures as the number from which it 18 ex- 
tracted. 

In connection with the question of accuracy, the dro|qping 
of decimals should be considered. The general rule is that 
whenever the first figure dropped is five or more, the preceding 
figure should be increased by one. For example, if the number 
3.2347 IS to be reduced to three decimal places, it becomes 
3.235; if it IS to be reduced to two it becomes 3.381, not 3.24. 
In other words, if a decimal is to be shortened, tilds should be 
done in one operation and not one place taken off, then another, 
another, and so on. 

In dealing with quantities that are to be added the practice 
just described is often vaned insofar as numbers contaming five 
in the decimal place to be elimmated are concerned. It can 
be seen that if, when a five is dropped, the preceding figure is 
always mcreased there will be a cumulative or biased error in 
the total as there will be no compensating decreases to balance 
these increases Therefore in such a situation the g ^25 3 72 
convention is frequently adopted of increasmg the 4 315 4,g2 
figure preceding five by one if it is odd, and of 1.975 1.98 
dropping five without increasing the preceding 2.435 2.44 
figure if the latter is even. Thus, for example, if 
the quantities shown in the first colimin at the right 
were reduced from three to two decimal places for addition 
they would appear as shown in the second column. 

Another point that should be watched arises in the deter- 
mination of per cents and similar expressions, usually in division. 
It is that the division or other computation should be carried 
far enough to furnish evidence as to what the last figure to be 
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.16 kept should be. For example, if one is to determine 
120.| 2(t.00 what per cent twenty is of one hundred and twenty, 
12 0 it will not lead to an accurate result to proceed as 
8 ^ shown and thus get 16 per cent. Instead the division 

should be carried to another place, thus indicating 

that the result is nearer 17 than 16 per cent, and should be 
given as such if not more than two places are to be carried. 

Another general principle that the statistical worker should 
never forget is that the methods used should be as simple and 
as easily understood as is consistent with the results wished. 
Refined procedures and complicated methods should be em- 
ployed only when there is a justifiable reason for doing so. In 
dealing with measures that are not highly accurate the use of 
elaborate statistical procedures may serve chiefly to contribute 
to a false idea of accuracy. 

A general reference. For those who are doubtful whether 
or not they possess the mathematical knowledge and ability 
to do work in statistics, the writer recommends a volume by 
Walker.** It contams a senes of chapters on the requisite mathe- 
matical fundamentals and self-tests for use by students at be- 
ginnings and endings of chapters. 

Exehcises 

1. How many significant figures has each of the following? A. .011, 
B. 2.1450, C. 73.9, D. 410,000., E. .000283, F. .419720, G. 5.005, 
H. .2936. 

2. Have each member of the class weigh himself and report the 
result Add these weights, and detenaiaal^ nearly their sum agrees 
with the actual combined weight of the class. If tliis is impracticable, 
employ some other series of measurements that illustrates the same 
point. 

3. Determine by actual calculation the relative accuracy of a product 
whose factors are 1.03, 4.04, 3.57, and 6.6.33, with absolute errors of .03, 

Helen M. Walker, Mathematics Essential Jar Elementary Slatistiet. 
(New York, Henry Holt & Co., 1934), 248 pp 

“ No exercises are given for this purpose, but it is recommended that 
students familiarize themselves sufficiently with such tables and machinee 
as those named in the text that they can make correct and reasonably 
rapid uah of them. 
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preasion, but are usually best so expressed. In some cases the 
number of numerical classes is definitely limited. For example 
in classifying pupils according to grade placement in the ordinaiy 
elementary school there are only eight grades, or perhaps sixteen 
half-grades, into which they can be grouped. In most instanaee 
of this sort the limitation on the number of groui» artificial 
rather than natural, being imposed by the organizatum oi the 
school or some other convention rather than inherent In the 
nature of the data themselves Thus in a system thl^ has 
thoroughly individualized instruction and allows each puffil to 
progress at the rate best suited to him, the number of groijpe 
on the basis of grade placement might be mcreased above ei^ht 
or sixteen almost without limit. 

In the case of measures of mental and physical ability there 
is ordinarily no hmit to the fineness of the grouping possible 
except that imposed by the fineness of discrimination of the 
measunng mstruments used. For example, m measunng height 
we ordmanly employ no unit smaller than a fairly large frac- 
tion of an mi'h, but we know that pupils do not increase in 
height by such sudden steps, but mstead do so gradually. 
Therefore, if fine enough measuring instruments are used, heights 
can be determined to any desired degree of prectsion and corre- 
iqxindmg classifications made. Similarly, in the case of the 
ordinary percentile marking system no division smaller than a 
single per cent is used, although a pupil whose knowledge ex- 
ceeds 78 per cent of perfection, f<»r example, does not necessarily 
know as much as 79 per cent of it, but his true status may be 
desmbed by some fraction betwemi 78 and 79. In the case of 
financial data the fineness of classification is ordinarily arbi- 
tewily limited by the fact that no smaller umt than the cent 
is used, and in many cases of salaries, by the fact that for a 
given unit of time, such as a month or a year, no smaller unit 
than a dollar, or perhaps than an even ten, fifty, or one hundred 
dollars, is employed. 

In addition to the terms already used, certain others are 
sometimes employed in this connection. Verbalfclasaification 
is synonymous with classification by attributes, or in unordered 



16 


STATISTICAL METHOD IN EDUCATION 


seiies, and numerical classification with that by variables, or 
in ordered senes. Sometimes also the terms qualitative and 
quantitative are employed in corresponding meanings, but it 
«eems to the writer that their use m this way is not desirable, 
fw the reason that quality as well as quantity may be, and 
often is, expressed in numencal terms. 

Although data are sometimes referred to as being ordered or 
unordered in their nature, it is frequently true that their classi- 
fication as one or the other is neither inherent nor conventional, 
but is determmed by the way in which one desires to classify 
orl^dle them. For example, pupils may be classified on the 
haaw of birth as native-born of native parents, native-born of 
forelsu parents, and foreign-born, thus making classes on the 
basis of attributes. If, however, it is possible to trace pupils' 
ancestry back a number of generations, numerical classes may 
be establuhed on the basis of the per cent of foreign blood. To 
give another example, pupils may be grouped according to their 
marks as deserving promotion or failure, or they may be grouped 
into numencal classes on the basis of per cents, points, or some 
other numerical system of marking. It is always possible to 
group data as attributes rather than as variables, but there is 
rarely enough to be gained by douig so to justify it. In most 
instances numencal classes are preferable to classes described 
in terms of words, and should, therefore, almost always be used 
when possible. 

The need for grouping or classif|^ng data. Educational data 
as well as those in any other field are composed of collection^ or 
series of single cases. From one standpoint, a mere list of meas- 
ures or scores as they occur may be considered the simplest 
form in which to deal with them For example, ^e following 
are the scores, that is, the numbers of words spelled correclfy, 
of a class of twenty pupils on a spelling list of eighty words; 
53, 69, 43, 59, 70, 72, 47, 28, 56, 77, 62, 68, 74, 36, 49, 62, 66, 
56, 64, 51. Even though the number of pupils is rather small 
it is somewhat difficult to get a very clear idea of their scores 
from the series just given. The situation can be more easily 
grasped if they are arranged in order as follows: 28, 36, 43, 
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47, 49, 51, 53, 56, 56, 59, 62, 62, 64, 65, 68, 69, 70, 72, 74, 77* 
By looking at this senes, noting the lowest and highest scoro^ 
and that about the middle half come in the fifties and sixtioB, 
one can get a fairly good idea of the total situation. 

In many mstances, however, it is desirable to group the sooras 
into a few classes, so that a more summanzed idea of tlie aeries 
may be obtamed. Since the lowest score is 28, and the 
77, and classes of ten are rather convenient, the scores liai^ 
well be grouped according to whether they fall in the Tajjnjv# 
twenties, the thirties, and so on, up to the seventies. 

The manner of doing this is illustrated by the tabula- 
tion at the right. In this the column of numbers followed w"ljj 
by dashes stands for the various classes, that is, 20- is ' 
understood to mclude all scores of from 20 up tp but ’ 
not includmg 30, 30- all those from 30 up to but hot including 
40, and so on. In tabulating it is customary to male vertical 
marks, one for each case or score, as shown and, for convemenoe 
in counting, to use a diagonal mark, or sometimes a honzontal 
one, running through the last four to complete each set of five 
in a class. Thus the four marks or talhes after 70- mdicate 
that there are four scores of 70 or above but not so great as 80,, 
the six following 60-, that there are six at or above 60 but 
below 70, and so on for those in the other dasses. Or- 
dinarily after such actable has been completed it is re- 
written, usmg figuvlitlb^t^-^ of marks, as shown 
at the left. Such an arrangement of scores is called a 
frequency distribution or tabulation, or a grouped or 
classified series, in contrast with a list of scores such as 
was given above, which is called a simple or ungrouped 
881 ^. The/ at the head of the second column of figures 
is the conventional abbreviation for frequency and refers to the 
number of cases in each class. N, used at the bottom of the 
column, stands for number, and refers to the total or number 
of cases in all classes together, that is, in the whole distribution. 

It is reidily seen that the frequency distribution just given 
with its comparatively small number of classes can be more 
readily comprehended and kept in mmd than the series of 


/ 

70- 4 
.60- 6 
/ 60- 6 
40- 3 
30- 1 
20-_l 
N^20 
r 
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kidividual scores. In the case of such a small series as the one 
given, however, the difference is not so great as when more 
cases are concerned. Indeed, it is doubtful if it is worth going 
to the trouble to make such a tabulation in the cases of most 
series of as few as twenty or twenty-five scores. For senes of 
greater length than this, however, it is usually desirable to do 
so, since only exceptional mdividuals can keep a series of forty 
or fifty or more scores well in mind. For example, suppose 
thatJ^enty additional scores of the same sort are added to 
the Wrenty already given, making a total of forty as follows, 
arranged in order 24, 28, 3^ 35, 36, 39, 43, 44, 47, 49, 50, 51, 
53, 64, 55^56s 56, 57, 58, 5< 61, 62, 62, 62; 63, 64, 65, 6^, 66, 
68, 68, 69, 70, 71, 72, 72, 74, 75, 77, 78 One can see at once 
what the lowest and highest scores are, and after some inspec- 
tion determine about the average and the range covered by the 


/ 

70- 8 


middle half or some other convenient fraction, but it is 
more difficult to do so than when the number of scores 


60- 12 was only half as great. If, how ever, the scores are tabu- 


50- 10 lated mto the distribution given at the left, they are 
^ 4 no more difficult to comprehend and remember than 
^ 2 twenty. Therefore it is the almost universal 

^ ^ — practice in connection with statistical work to group 
senes of thirty or forty or more scores into frequency 


distributions rather than to leave them in sunple or ungrouped 


series. 

Grouping or classifying scores. The preceding discussion has 
been intended to pomt out the need for grouping or classifying 
scores, but no attention has been given to the best way of 
doing so from the standpomt of the number, size, and limits 
of the classes. These pomts, therefore, will be dealt with in 
this section. Before proceedmg to do so, however, it seems well 
to explain a few terms. The term doss or, more rarely, group 
or which has already been used, is best applied to the 
position or location on the scale of magmtude that includes the 
particular measures or scores grouped together. Thus, in the ' 
last distribution given, the two lowest scores, 24 and 28, are 
said to be in the 20- class, the four immediately above them 
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in the 30- class, and so on. The width of a class or, in otiuar 
words, the distance from the lower limit of a class to the lower 
limit of the next class, is called the class interval, or simply tihe 
interval. In the distribution given it is ten.* In common usage, 
however, the terms doss, interval, and step are used with porae- 
tically no distinction. Thus, reference is commonly made to 
the 20- class,^ the 20- interval, or the 20- step. P^4iaps the 
best way to avoid any confusion as to meanmg is to iqieak of 
the width of a class interval or step when one wishes to refer 
to the distance from the lower limit of one class to tbiq||M^er 
limit of the next 

In defining class reference was made to the scale of magnitude 
of the measures concerned. As used m this expression, scale 
has the same general meaning as m the measurement of length, 
height, or weight. In other words, a scale is a measuring in- 
strument divided into suitable units of measurentent by the 
use of which the magnitude of each case or measure can be 
determined. Thus, m the example used above the scale of 
measurement is a scale of words spelled correctly divided into 
units of one word each, m just the same fashion that a scale for 
measurmg t<‘achers’ salaries would probably consist of umts of 
one dollar and a scale for height of units of one inch. 

Reference has been made to the lower and upper limits of a 
class These are abbreviated by I and u, respectively, and refer 
to the lowest and highest values which the variable being dealt 
with may assume and still be grouped in that class. Thus a 
variable with a value of 40 would be the lowest possible one 
t6 be placed m the« 40- class, whemas one with a value of 
49 99 . . . would be the highest that should be placed in that 
class. For the reason already indicated, however, the upper 
limit of a class is conventionally taken as the lower limit of 

* More strictly speaking, n class interval is the distance from the lower 
limit of a class to its upper hnut, m this case from 20 to 29 99 . . or, 
in other words, 9 99 . I'or the sake of convenience, however, it is 
taken as stated above, thus avoiding the use of an unlimited decimal, 
t • The complete term refemng to this class would be the “ 20-up-to-but- 
not-including-30 class,” but because of the length of this expression, it is 
oommonly shortened to the ”20- class.” 
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^ next class rather than as the theoretically correct upper 
limit. A score of 50, however, belongs in the 60- class and not 
in the 40- one. 

In grouping individual cases or measures into classes there 
are a few general principles that should be followed. Sometimes 
they conflict, but insofar as possible they should serve as 
guides. The most important one is that classes and their limits 
should be so chosen that the resultmg distribution is representa- 
tive of the original series of individual measures. In general 
the more classes there are, the better is this condition fulfilled, 
but if this IS earned to too great a h'ngth, the frequency dis- 
tribution becomes so long that there is little gam m emplojong 
it as compared with the ungrouped series from which it was 
derftfei 

Not^|nfy the number of claases, but also their width and 
limits, ^ect the accuracy with which a frequency distnbution 
represents the onginal measures To take an extreme case, 
suppiose that in a school system teachers’ salaries are such that 
the last two fiigures thereof are always 10, 20, or 30 In other 
words, if any teacher receives more than $1230, she receives 
at least as much as ^ll^ilO; if more than $1330, at least as much 
as $1410, and 9i)g0ii. If these are grouped in $100 classes of 
which the lower limits me the even hundreds, the resulting 
frequency distribution is not at all a satisfactory representation 
of the actual facts. It shows how many teachers receive salanes 
between $1200 and $1300, how many between $1300 and $1400, 
and so on, but there is nothing about it to indicate that the 
salaries are all within less than the lower one-third of the range 
covered by each class. It is better m this case, although ratji||^ 
pnusual, to have one class run from $1170 up to but notJlH 
'^uding $1270, another from $1270 up to but not including 
$1370, and so on, so that the mid-pomt of each class, $1220 
in the first instance, $1320 in the si'cond, and so forth, will 
correspond approximately to the actual mid-point or average 
cS the salaries in that class. 

Since the puipose of groupmg is to render the data concerned 
more easily comprehended and dealt with, it follows that the 
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number of clasaes ^ould b© small as can adequately repress# 
the original measures, and the class widths and limits shodd 
be such as can be most easily dealt with. The first of then 
two requirements usually conflicts directly with that stated 
above, that there should be enough classes to represent the 
original data with little loss of accuracy. Thus in practice one 
must commonly compromise between these two principles. It 
is generally agrc'ed upon that from ten to twenty classes is tJie 
best number. This depends, however, to some extent upon the 
accuracy and meanmg of the data themselves, and also upon 
the number of cases included Thus, the frequency dis^ 
tribution of the twenty scores given on page 17 is ■' 

probably reasonably satisfactory as it is, even though 75- 3 
there are only six classes, while that of the forty score^ * 
on page 18 would probably be unproved by increasing gQ_ ^ 
the number of classes Therefore this has been done 5 ,^ g 
and the resulting tabulation by classes of five instead 50- 4 
of ten is given at the right- As a general rule, but only a 45-2 

general one, it may be suggested that if the number of ^2 

cases is not greater than forty or fifty, it is rarely de- ® 

sirable to have the number of classes.jppch if any in 25 - 1 

excess of ten, whereas if there are mai^i|||l|housands 20 - 1 
of cases, the number of classes should probably be at N =■ 40 
least fifteen. In some instances when there are very 
large numbers of cases it is p^haps well even to exceed twenty. 

It will be noted that m tllte' first two frequency distnbutions 
given above, the width of the classes was ten and that in the 
vi, viaa Thi?, liVvvsAsafcea \.Wi. ’s vwfAay 

||||p 8 widths familiar or commonly used numbers rather than 
Hp usual ones such as seven, thirteen, and so forth. A frequently 
"helpful method of determining the number of classes is to taleq 
the most convement nuipber that, when divided into the dif- 
ference between the highest and lowest scores or measures, 
gives a quotient of between ten and twenty. Thus in the case 
’of the forty scores given above, the distance from 24, the lowest, 


fe 

Sf 


to 78, the highest, is 64, therefore either three, four, or five 
may be used as a class mterval and will 3 aeld not less than ten 
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aor more than twenty classes. In this case, since the total 
launber of cases is relatively small, and also since five is a more 
’ familiar unit of counting to most persons than three or four, 
five was used. 

The same principle applies to the choice of lower and upper 
limits as to the choice of class widths — that it is well to have 
them in familiar or round numbers. It is thus much more 
natural to the ordinary person to work with a distnbution in 
whiclv the lower limits are, respectively, 20, 25, 30, and so on, 
than with one in which they are 22, 27, 32, and so on, or 24, 
29, 34, and so on Therefore, instead of making the lower 
U^iyiiKthe first class 24, which is the value of the lowest score, 
IfHHH^en, and, correspondingly, 25, 30, and so on, for the 
RHhb. Sometimes this is violated in order to have a round or 
wen n^tober for the mid-pomt of the class rather than for its 
limits. In the given distribution the mid-points are, of course, 
22.5, 27.5, 32.5, and so on. If, however, the lower limit of the 
first class is 22.5, that of the second class 27.5, that of the 
next 32.5, and so on, the mid-pomts will be 25, 30, 36, and so 
on. As the advantage of having round, even, or familiar num- 
bers as mid-points is seldom so great as that of having them 
as bmits, the other practice is usually followed. Moreover, it 
is generally convenient that the limits be so chosen as to be 
multiples of the class width. 

Occasionally a senes of data is encountered in the tabulation 

which it IS best to violate at least technically the principle 
stated above, that the number of classes should be from about 
ten to twenty. To illustrate this, suppose that a tabulation is 
being made of the salaries of all teachers in the school system 
of a small city; that the salanes of elementary teachers therein* 
range from JIOOO up to $1500; those of high-school teachen 
from $1250 up to $2000; and that the only persons receiving 
more than $2000 are the high-schooI pnncipal, who receives 
$3250, and the supermtendent, who receives $4500. The dis- 
tance from the lowest salary, $1000, to the highest, $4500, 
is $3500, which suggests that classes with a width of $200 
or $250 are appropriate. If these are used, however, all the 
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persons concerned except two are grouped in the first 
few classes and, for purposes of accurate representation '• 
of the original data, are probably not sufficiently dis- 
tributed. In such a case it is better to apply the rule 2OOO- 
of from ten to twenty classes to the bulk of the cases, 1900- 
in this instance the elementary and high-school teachers, 1800- 
without consideration of the few exceptional ones. 1700- 
Thus, m this case $100 intervals beginning at $1000 ^ 
may well be used with a break in the tabulation be- \ i400_ 
tween $2000 and $3200, and another between the latter 130O- 
and $4500. The lunits as given in the tabulation 
then appear as shown at the right. To save space and4^H||||| 
make a more compact table the break between $2000 
and $3200, and that between the latter and $4500, am ins^tX 
mstcad of the lower limits of all possible classes wftin those 
mtcrvals. 

An important assumption concerning grouped or tabulated 
measures is that, after the grouping has taken place, all cases 
or measures withm each class are assumed to be symmetrically 
distributed about the mid-pomt of that class. For some pur- 
poses this amounts to the same thmg as assuming that they 
are concentrated at the mid-pomt, but for others the two sup- 
positions are not equivalent. Thjs assumption renders it de- 
sirable that classes and thdfr limits be so chosen that their 
mid-pomts comcide as nenxly as possible with the actual mi^ 
pomts or averages of the cases that fall wnthm them, and thus 
make a groupied distribution as representative as possible of 
the original cases which compose it. For example, if teachers’ 
salanes m a school system are all in even fifties and hundreds, 
classes runmng from $975 up to $1075, from $1075 up to $1175, 
and so on, with mid-points of $1025, $1125, and so on, are 
more representative of the data than are classes from $1000 to 
$1100, from $1100 to $1200, etc., with mid-points ending in 50. 

It was just stated that the assumption underlying grouping 
is that the measures within a given class are symmetrically 
distributed about the mid-point of that class. This assumed 
symmetrical distribution is illustrated in Figure 1. £lach in- 
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ttival is assumed to be divided into as many equal parts as 
it Contains measures, and one of its measures to be located at 
tbe mid-point of each part. In the figure each x shows the 
assutped location of one score. The zero-interval, that is, the 
distance from 0 to 1 on the scale, is divided mto two equal 
parts .'CPd the two cases therein are assumed to be at the re- 
spec0ve mid-pomts of the two equal parts, 0 to .5 and .5 to 1. 
These mid-points are, of course, .25 and .75. The four cases 
in thei||exf interval are assumed to be at the mid-points of 
four e^al parts into which this mterval is divided. Therefore 
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• REPRESENTATION OF SYMMETRICAL DIS- 

OF MEASURES WITHIN EACH CLASS 


they fall at l.\25, 1 375, 1 625, and 1.875. In a sunilar fashion 
the three in the^next mterval fall at 2 166 . . ., 2.5, and 2 833 . . . 
The one case h^he last class falls at its mid-point, that is, 
at 3.5 It is reiaily ^pparent that the mid-point of each in- 
terval 18 the etaf^ avetfikge or mean of the measures contained 
in that interval. 

The assumption explained in' the above paragraph is in gen- 
eral only approximately true. It is usually the case that if in 
the whole distribution there are more measures above a given 
class than below it, over half of the measures m that class are 
above and less than half below its mid-pomt, and mce versa. 
The error involved in makmg the assumption referred to is 
usually so small, however, that ordmarily no consideration ia 
given to it. If the distribution is fairly symmetrical the errors 
on one side of its center tend to balance those on the other in 
computations for certain purposes, but in others their effect ia 
cumulative and may be serious. Corrections for this effect 
will be suggested later. 

Occasionally one sees frequency distributions in which the 
widths of all the intervals are not the same. However this is 



TABULATION AND CLASSIFICATION 


25 


rarely the best way of constructing such distributions, and 
should never be followed unless one of two reasons seems tO 
demand it. One of these absolutely requires it, but rardy 
occurs. It IS that at one or the other end of the distribution, 
usually the upper, there be an unlimited class. For example, 
in tabulating incomes it is sometimes impossible to det^fmine 
accurately the incomes of the few wealthiest mdividuSlfi, so 
that it 18 frequentlj' necessary to have a highest class of whidl 
only the lower limit and not the upper one is known. 

The other of the two reasons referred to above occt^ more 
commonly, but docs not always justify the use of clsisfes of 
different widths It is a situation in which the bulk of the in- 
dividual cases fall within a comparatively narrow rangp on the 
scale, and yet there are enough spreading over a comparatively 
wide distance on the scale outside of this range so that it is 
not satisfactory to treat them as was suggested salaries 

of the principal and superintendent m the exanBr given on 
page 23. Thus in a large city system the salari« ot classroom 
teachers may range from SllWO up to 14000, and those of the 
much smaller number of prmcipals, supervnsors', assistant super- 
intendents, and other administrative and sujpervisoiy officials 
may range on up to $12,000 with no, or,. 9 h&ost no, interval of 
more than a few hundred dollars within whiolwit least one does 
not occur. In this case an mterval of $1000 perhaps seems 
desirable from a consideration *6f the range between the lowest 
and highest salaries, but such an interval does not group the 
classroom teachers’ salaries with sufficient accuracy. Further- 
more, an interval small enoujdi to be satisfactory m their case, 
such, for example, as $250, results in entirely too many classes 
for the whole distribution. In such a cast' it is sometimes best, 
therefore, to employ classes of two or occasionally even more 
widths. In the one just given $250 or perhajis $500 may be 
used in the lower classes and $1000 m the upper, thus giving 
classes of $1000 to $1250, $1250 to $1500, and ao on, or of 
$1000 to $1500, $1500 to $2000, and so on, up to $4000, then 
of $6000 to $6000, $6000 to $7000, and so on up to $12,000. 
Such cases as this, however, occur rarely in deahng with most 
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t^pes of educational data, such as scores on educational or 
intelligence tests, school marks, pupils’ ages, weights, heights, 
and so on. 

A question that arises in connection with distributions in- 
volving the percentile system of marking is how to mclude both 
zero and 100 per cent m the classes. When the range is from 
zero to 100 mclusive, there are 101 possible scores included, 
hence there is no divisor or uniform width of class mterval 
which can be used so that zero will be the lower limit of the 
lowest class and 100 the upper limit of thi^ highest class There 
are two methods of procedure. The lowest class may mclude 
zero up to but not mcluding 5, for example, and so on, until 
the next to the highest class includes 95 up to but not including 
100, and the highest class contains only those measures of 
exactly 106.^ The other procedure is to have a separate class 
for the zero pleasures, the next class embracing 1 up to but 
not including 6, and so on, until the last contains 96 up to 
and including 100. The decision as to which plan to use should 
rest chiefly on two points. These are grouping the cases so 
that the original measures are best represented, and whether 
from the nature of the data or what is to be done with them it 
is more desirable to keep the zero scores or the 100 per cent 
scores in a separate group. 

In the frequency distributions given so far the classes have 
70-79 99 represented or delimited by their lower limits 

@0-59 99 followed by a dash. This is the conventional practice 
50-59 99 in this respect, but other methods are occasionally 
40-49.99 employed. A satisfactory one except that writing it 
requires slightly more labor and space differs from 
the other merely in that following the dash it gives 
the upper limit, usually carried to two decunal places. Thus 
for the distnbution given on page 17 the classes 70.7999 
would be denoted as shown at the left. Sometimes a 0O- 
compromisc between the two methods is used in that 50- 
the upper limit of the upper class only is given In 40- 
the same case just used the limits would, therefore, 
appear as shown at the right. ^ 
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Aa contrasted with these there are two undesirable methods. 
One IS the method of designatmg classes by their mid- 
05 points, sometimes called the claas marks or doss types. 
55 Thus for the example just used the classes would be desig- 
ns nated as shown at the left. The objection to this form is 
^ that it is not convenient to use in tabulating, smce a mere 
glance at the mid-pomts does not show m which class a 
given case falls. 

A still worse practice is to give limits as shown at the r^bt. 
This system employs the lower limit and a dash followed by 
the lower limit of the next class instead of the upper 
limit of the same class The chief objection to this is 
that it is confusing and does not mdicate where scores 
that come just at the lower limits belong For example, 

60 appears both as the upper limit of the 40- class aiid 
as the lower limit of the 50- class, so that when a score 
of 50 18 to be tabulated, one is confused as to where to put it. 
It should, of course, be in the 50- class. 

In connection with classifying individual cases into frequency 
distributions it should be noted that such distributions may 
be either continuous or discontmuous. A continuous distribu- 
tion 18 one m which there are no gaps, or, in other words, m 
which the trait being measured may be subdivided infinitesi- 
mally to any desired degree. A good example of this may be 
found m the case of weight. There is no sudden gap m weight 
between individuals who weigh, for example, 121, and those 
who weigh 122 pounds, nor can such a gap be obtamed by re- 
fining the measurements to any given degree. We may measure 
to ounces instead of pounds, to grams instead of ounces, and 
even still more accurately, but we can never reach such a small 
unit that further subdmsion is impossible, provided we have 
instruments fine enough to make it. In some cases the meas- 
uring instruments used appear to leave a defimte break when 
this is not the case. For example, in markmg spelling ability 
the whole word is usually taken as the unit. There is, however, 
no absolute gap between a pupil who can spell eight words out 
of ten correctly and another who can spell nine, but many de- 
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grees of spelling ability may exist between the degrees possessed 
by these two pupils. One pupil may know how to spell eight 
Words and know nothing at all about the ninth, another may 
know a very httle about the ninth, and so on, until finally 
there is one who just barely misses spelling it correctly. 

A discontinuous or discrete senes or distribution is one in 
which there are gaps. If the number of pupils in a room is being 
considered there can be no finer division than one pupil. In 
paying teachers’ salaries there can be no further division than 
a cent according to the means ordinarily used. Indeed, as 
salaries me usually paid, there is no subdivision beyond a 
dollar ahd often not beyond twenty-five, fifty, or even one 
hundiid dollars In some instances discontinuous series may 
be divide .so finely in proportion to the ma^^nitude of the 
measures that for all practical purposes they may be regarded 
as continuoua This is true of the example of teachers’ salancs 
given above, since when salaries range into thousands of dollars 
subdivision to single cents represents practical continuity. Such 
series are sometimes called pseudo-contmuous. In general sta- 
tistical procedure no difference is made, but all frequency dis- 
tributions or tabulations are treated as continuous unless it is 
otherwise stated or very evident that they cannot be. 

Cumulative frequOn^y tebles. Another form of table that is 
sometimes useful is a cumulative frequency table. In such a 
table the entnes or frequencies indicate the total number of 
cases either in and below in and above each class. To con- 
struct such a table an ordinary frequency table of the sort 
previously illustrated must first be made. The frequencies 
therein are then summed continuously to give the frequencies 
in a cumulative table. This process is illustrated by Table I 
which gives the ordinary frequency distribution and the cumu- 
lative distribution from the lower end up for the same forty 
cases as have been previously used. In this, as in any cumu- 
lative table made from the bottom up, each cumulative fre- 
quency shows the number of cases in and below the class td?*, 
which it belongs, and is obtained by summing the ordinary^ 
frequenci^ of ail the classes up to and mcluding that one. 
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TABLE I 

CrmuLATiTE Fbbqdunct DisTBrannoN 
Showing Nhicbih and Per Cent or 
Cases in and beiow Each Ciasb 


/ 

Cum f 

Cum % 

75- 3 

40 

100 0 

70- 5 

37 

92.5 

65- 6 

32 

80.0 

60- 6 

26 

650 

65- 6 

20 

500 

60- 4 

14 

35 0 

45- 2 

10 

25.0 

40- 2 

8 

20.0 

35- 3 

6 

15 0 

30- 1 

3 

7.5 

25- 1 

2 

60 

20- 1 

N - 40 

1 

2.5 


Thus the cumulative frequency m the given distribution in the 
20- class 18 1, the same as the ordinary frequeiwqr.* In the 25- 
class it is 2, obtained by adding 1 and 1, and is to be interpreted 
as meaning that there are two cases in and below the 25- class. 
In the 30- class the cumulative frequency is 3, found by adding 
1, 1, and 1, or by adding the 1 m the oi^bixy frequency column 
in the 30- class to the 2 in the cumulative frequency column 
in the 2&- class. The latter method, adding the ordinary fre- 
quency in the desired class to the qpnulative frequency at the 
class immediately below the one for which it is desired, is the 
most convement method of securing a cumulative frequency. 
For example, the cumulative frequency for the 70- class may 
be obtained by addmg 5, the ordinary frequency in that class, 
to 32, the cumulative frequency for the 65- class, thus giving 37. 

In the interpretation of this type of cumulative table it 
should be noted that since each frequency represents the total 
number of ce^ in and below the class to which it belongs, it 

t eans that this number of cases is below the upper limit of 
at chue, or, in other words, below the low'er limit of the next 
mass above. Thus, for example, the 3 opposite 30- indicates 
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that there is a total of three cases below 35; the 14 opposite 
50-, that there is a total of fourteen cases below 55, and so on. 

In cumulative frequency tables it is rather common to add 
another column, as is shown m the example, giving the cumu- 
lative per cents. The entries are readily obtained by dividmg 
each entry in the cumulative frequency column by the total 
number of cases. Thus, beginning at the bottom, one divided 
by forty equals 2.5 per cent, two divided by forty, 5 0 per cent, 
and so on up. The interpretation of this column is exactly the 
same as of the one preceding it, except that it is in terms of 
per cents and not actual numbers of cases. Thus the figures 
given in this column show that 2 5 per cent of the cases are in 
or below the 20- class, or, in other words, below 25; that 5 0 
per cent are in and below the 25- c!as.s, or below 30; and so on 
up, 100 per cent or all of them being, of course, m and below 
the 75- class, that is, below 80 

TABLE II 

CCMUIiATlVE FREQCENrY DISTRIBUTION 
Showing Number \ni> Per Cent of 
Cases in and above Each Class 


/ 

Cumf 

Cum % 

75- 3 

3 

7 5 

70- 5 

8 


65- 6 

14 


60- 6 

20 


65- 6 1 

26 


60- 4 ! 

30 


45- 2 

32 


40- 2 

34 


36- 3 

37 

92 5 

30- 1 

38 


25- 1 

39 

97.5 

20- 1 

TV - 40 

40 



The cumulative frequency distribution running in the other 
direction, which shows the number of cases in and above each 
class, for the same data is shown in Table II. It is constructed 
exactly as the former one except that it is begun at the upper 
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end of the ordinary frequency distribution rather than at its 
lower end. It shows, therefore, that there are three cases, or 
7.5 per cent, in the 75- class or above, or, m other words, above 
75, that there are eight cases or 20.0 per cent above 70; fourteen 
cases, or 35.0 per cent, above 65; and so on. 

Exercises 

1 Which of the following are usually best dealt with as variables and 
which as attributes? 

A. Height E. Intelligence quotient 

B. Color of hair F Per capita cost 

C. Nationality G Major subject 

D School mark H. Attendance 

2. Tabulate the following teat scores in a frequency distribution 74, 
49, 103, 95, 90, 118, 52, 88, 101, 96, 72, 56, 64, 110, 97, 59, 62, 96, 82, 
65, 85, 105, 116, 91, 83, 79, .52, 76, 84, 89, 77, 104, 96, 84, 62. 58, 66, 100, 
80, 54, 75, no, 99, 104, 78, 66, %, 83, 57, 60, 51, 114, 120, 101, 92, 88, 
64, 63, 95 

3 Tabulate the following high-school cnrollmente in a frequency 
distnbution 121, 56, 425, 87, 205, 42, 74, 1.52, 77, 238, 33, 84, 125, 386, 
12, 63, 31, 164, 90, 102, 28, 748, 29, 36, 270, 78, 50, 219, 35, 70, 142, 
18, 224, 131, 79, 64, 23, .52, 94, 100, 65, 172, 82, 1437, 218, 91, 40, 66, 
48, 37, 550, 68, 87, 99, 336, 78, 44, 86, 162, 461, 39, 83, 17, 284, 32, 85, 
75, 119, 62, .54, 195, 33, 47, 81, 43, 74. 

4. Tabulate the following ages, given in years and months, in a 

frequency distribution 9- 6, 8- 9, 9- 3, 10- 2, 9- 9, 9- 8, 8- 11, 
10- 7, 9- 0, 9- 5, 9- 11, 8- 6, 11- 0, 9- 7, 9- 4, 9- 1, 9- 0, 10- 3, 

10- 5, 9- 4, 9- 9, 9- 10, 8- 10, 9- 7, 9- 6, 9- 5, 8- 2, 11- 4, 9- 6, 

9- 3, 9- 9, 10- 4, 8- 10, 9- 3, 9- 2, 9- 7, 9- 8, 10- 3, 10- 7, 9- 10, 

9- 1, 9- 6, 8- 8, 12- 1, 9- 4, 9- .5, 11- 3, 9- 6 

5. Tabulate the following per capita costs m a frequency distribu- 
tion: $148.72, 126 51, 164.85, 110.50, 147.26, 183.59, 221.35, 164.89, 
153.21, 176.88, 132.57, 148.21, 105 16, 124 22, 165.52, 152.27, 184.92, 

174.28, 136 21, 139 84, 119 61, 1,51.38, 142.70, 160 55, 136 41, 98.50, 

158.29, 144.48, 176J21, 180,54, 142 26, 187.22, 170 60, 148 29, 153.37, 
166.38, 136.41, 174,89, 155 33, 160.42, 143.94, 127.22, 236.15, 193.75, 
128.64, 132.56, 178.33, 165 43, 149 80 

6. Make the ciunuktive distributions for Exercises 2 to 5. 



CHAPTER III 


THE GRAPHICAL REPRESENTATION OF 
FREQUENCY DISTRIBUTIONS 

The coordinate axis system. Practically all graphs used in 
statistical work are baaed upon the coordinate axis system 
commonly used in mathematics. Figure 2 shows this ^stem 

Y 


X 


FIG 2. THE COORDINATE AXIS SYSTEM 
Points A(4,2), B(l,-5), and C(-4, -3) are shown thereon 

in its simplest form. It consists of the X- and F-axes, of which 
the former is a honzontal straight hne and the latter a vertical 
straight line perpendicular to it. Ihe point at which they mter- 
sect, labeled 0, is known as the origin and is the zero pomt of 
the scales laid off on the two axes. Distance on the X-axis to 
the right of the origin is positive, that to the left of the origin 
is negative. On the F-axis distance above the ongm is positive, 
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distance below it negative. Therefore all X values to the ri^t 
of the F-axis and all Y values above the X-axis are positive, 
whereas all X values to the left of the F-axis and all F values 
below the X-axis are negative. 

The four divisions into which space is divided by the two 
axes are called quadrants. The upper right one, commoni^ 
called the first quadrant, is the only one used in most gra^;^ 
representations of frequency distributions. Since it is to 
right of the X-axis and above the F-axis, it is positive with 
respect to both variables X and F and may be characterized, 
therefore, by two plus signs. The upper left, or second quadrant, 
18 negative for X values and positive for F values, as is indicated 
by the signs placed in it. The lower left, or third quadrant, is 
negative for both variables, and the lower nght, or fourth 
quadrant, is positive for X and negative for 

The simplest use of the axis system just described is in con- 
nection with the location of pomts. The position of a point is 
defined by stating its X distance, that is, its distauace away 
from the F-axis measured parallel to the X-axis, followed by 
its F distance, that is, its distance away from the X-axis parallel 
to the y'-axis The first is called its abscissa, the second, its 
ordinate. Thus the pomt A m Figure 2 has an X distance or 
abscissa of four and a Y distance or ordinate of two. Since both 
are positive, A is located four units to the right of the F-axis 
and two units above the X-axis, as shown m the figure. Its 
location is commonly indicated thus: 4,2. To give another 
example, the point B (.1,-5) has an abscissa of one and an 
ordinate of nunus five; therefore it is located, as shown, one 
unit to the right of the I'-axis and five units below the X-axis. 
As still a third example C (-4,-3) may be taken. It has an 
abscissa of mmus four and an ordinate of mmus three, so that 
its position is in the third quadrant as shown. 

If the two variable.s represented by a graph are a trait or 
characteristic being measured and the amount or frequency 
thereof at each magnitude, it is usual to plot the scale that 
measures the variable horizontally, that Is, upon the X-axis, 
and the one that measures the number of cases vertical^, upon 



34 


STATISTICAL METHOD IN EDUCATION 


the y-axis. Since in many cases no measures of the variable 
concerned approach zero, it is common to omit a portion of the 
base line where it approaches the oripn or zero point, and to 
indicate such omission by a short broken Ime. Figure 3 illus- 
trates such a situation. It portrays the horizontal and vertical 
OT X and Y scales in the first quadrant as they would be drawn 
in preparation for the graphic representation of the percentile 

marks of a group of pupils, 
no one of whom fell below 
50 per cent. 

In constructmg the hor- 
izontal and vertical scales 
for such graphs the units 
shown should be such that 
the whole distnbution can 
be shown m one figure. 
This figure should be large 
enough to make its signif- 
icant features readily ap- 
parent. The vertical scale 
should be sufficiently great 
that fairly small differ- 
ences in frequency from 
class to class are made clear K.\cept in rather unusual cases the 
height should not be less than half the width nor more than 
equal to the width. 

The histogram or column diagram. Probably the most com- 
mon and easily understood method of representing a frequency 
distribution is the histogram or column diagram. This is com- 
posed of a series of rectangles, each of which has as its base one 
class interval, and as its height the number of cases in the 
interv’al. The Imes separatmg one rectangle from the next are 
usually omitted, so that merely the line boundmg the whole 
figure is drawn. Such a graph for the accompan}ring distribution 
is shown in Figure 4. In this distribution, as will be seen, there 
is one case in the 40- class, none in the 50- class, three in the 
00- class, six in the 70- class, and so on. Therefore the histogram 


50 


■ 4 — 


60 70 80 90 

Per cent 


100 


FIG. 3 FIRST QUADRANT OF COOR- 
DINATE AXIS SYSTEM WITH 
BROKEN BASE LINE 

Tliis is drawn as it would be for representing 
scores from SO u{) to 100 per cent 
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begins by rising to a height of 1 above the 40- class, that is, 
from 40 to 50, then drops to the base Ime from 60 to 60, rises 
to a height of 3 from 60 to 70, to a height of 6 from 70 to 80, 
and so on. 

Probably the easiest way to construct a histogram is first 
•to locate dots at the two upper comers of each rectangle com- 
posing it Thus in the example just given a dot would be placed 
at a distance of one above 40 and another at the same distance 
above 50. Since there are no cases in the 50- class, no dots 
would be placed for this. For the 60- class there would>be 


Scon X 
140- I 



FIG 4 HISTOGRAM OR COLUMN r>IAGR.4.M 
This represents the data tabulated at the right 

one at a height of 3 above 60 and another at the same height 
above 70, for the 70- class there would be one at a height of 
6 above 70 and another at the same height above 80, and so 
on. A horizontal hnc is then drawn connecting the pair of dots 
above each class and a vertical line connecting the right hand 
dot for each class with the left hand one for the next class, or 
if there is none, as is the case at the beginning and end of any 
distribution as well as wherever there is a zero frequency, with 
the base line. 

The lines at^parating the various rectangles composing a 
histogram are inserted when it is desired to emphasize the 
various classes rather than the histogram as a whole. This, 
however, is rarely the case, so that such lines are not commonly 
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employed. In rare instances when it is desired to emphasize 
the sizes of the several classes and the distribution as a whole 



FIG 5 COLUMN DIAGRAM COMPOSED OP 
SEPARATE RECTANGLES 


Such a figure as this is used to rmiihasize the several classes. 


is of little significance, separate rectangles are drawn, with a 
small space between each rectangle and the next one. Such a 
representation of the same data used in the last figure is given 
in Figure 5. 

One advantage of the histogram over either of the other 


Score f 



FIG. 6. HISTOGRAM COMPOSED OF UNIT RECTANGLES 
REPRESENTING INDIVIDUAL CASES 


This figure r^resents the scores made hy a class of thirty ptipOM. 


common types of frequency curves is that individual cases may 
be shown by its use. This may be accomplished by dividing 
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the rectangle above each class interval into as many smaller 
rectangles as there are cases in it, or, in other words, into 
rectangles, each of which is as wide as the class interval and 
has a height corresponding to one unit on the vertical scale. 
Each of these small or unit rectangles can then be labeled in 
some way so that the mdividual whose score it represents can 
identify it. Figure 6 shows such a graph constructed to represent 
the scores made by the members of a class of thirty pu] 
a twenty-five-point test Each small rectangle coi 
number to identify the pupil whose score it represents, 
such a figure each pupil can see what his relative staaiki^ is 
in comparison with the other members of the class. the 
numbers are secretly assigned, no one need know each' pupil’s 
position except himself and the teacher. 

The histogram form of representing a distribution is com- 
paratively easy to make on a typewriter. Perhaps 
the best method is to use x’s or perhaps o’s for the 
individual cases, and to use for the width of a class 
one space on the machine How such a representa- 
tion of the same cases used in Figure 6 would ap- 
pear 18 shown at the right. Since the scales and so 
forth would be just the same as therein they are not repeated. 
25- X The process is made still easier if the scales are 

24- XXX reversed, that is, if the vertical axis is used to 

23- xxxxx represent the variable dealt with, and the hori- 
zontal axis the number of cases. This simpUhes 
t)rping since one can then start at the left edge 
or base line of the figure and type in a single hori- 
zontal line as many letters as there are cases in 
each class. This form for the same data just dealt 
with is shown at the left. 

The frequency polygon. A second common method of repre- 
senting a frequency distribution is the frequency polygon. To 
construct such a polygon a point is first placed directly above 
the mid-point of each class at the proper height to represent 
the number of cases therein. The points for the classes are 
then joined by straight lines and the resulting figure is a fre- 


X 

X XX 

XXXA 

xxxxxx 
X xxxxxx 

XX Xa-RjCXax. 


22- XXXXXX 

21- xxx\ 

20- XXXXX 

19- XXX 
18- 

17- XX 
16- X 
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quency polygon. At the two extregies of the distribution 
straight lines are drawn from the dots above the two extreme 
classes in which there are any frequencies to the base hne or 
X-axis at the middle of the class intervals just above the greater 
and below the smaller of the two extreme ones. The same 
practice is followed in the cases of any classes with zero fre- 
quencies. Such a figure for the same data as the histogram 
is dWwn in Figure 7. It was constructed according to the 
meUi^ just described. Since the frequency m the 40- class 



is one, a dot was placed at a height of one above 45, the mid- 
point of this class For the 60- class with a frequency of three, 
a dot was placed three points above its mid-point, 65; for the 
70- class a dot six points above 75, and so on. A straight Ime 
was then drawn from the base line at 35, the raid-point of the 
class immediately below the lowest class in the distribution, 
to the dot above 45; another from that pxiint to the base hne 
at 55, since there are no frequencies in the 50- class; another 
from this point to the dot above 65; and so on, until the figure 
was completed by connecting the dot above 145 with the base 
line at 155. 

It will be seen by companng this figure with that of the 
histogram that there is at least one marked difference. The 
area included by the histogram above each class as laid off 
on the base line corresponds to the number of cases in that 
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class; that is to say, the area there is equal to the width of the 
class times the number of cases. This is only by accident true 
in the case of the frequency polygon The total area of the 
polygon, however, is equal to the total area of the histogram 
for the same distribution. Furthermore, the histogram assumes 
that the measures in each class are umformly distributed within 
that class, whereas the polygon assumes that more of thendnui 
to fall m the half of the class adjacent to the one of thw two 
neighbonng classes which has the largest frequency. This is 
usually more in accord with the facts as they would be revealed 
by the use of narrower classes. 

The smooth frequency curve. The term frequency curve has 
two uses. In its broader and more general use it includes all 



This represents the same data as do the histogram in 
Figure 4 and the polygon m Figure 7. 


varieties of graphs representing frequency distributions, espe- 
cially the histogram, the frequency polygon, and the curve to 
be described in this section. In a narrower sense it is some- 
times used to refer to a smooth curve, such as is shown m 
Figure 8, representing a frequency distribution. 

For the sake of avoiding ambiguity it is better to prefix the 
adjective smooth when it is used in this sense and use the com- 
plete expression smooth frequency curve. In constructii^ such a 
curve dots are located in the same manner as for a frequency 
polygon. These are then joined by a smooth or Sowing curved 
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line, and thus a figure of the sort, shown is produced. Such a 
curve tends to elirnmate irregularities, and therefore does not 
rej^esent as exactly as the histogram or frequency polygon the 
actual data upon which it is based If, however, these data are 
tftlfpn as a representative sampling of a larger number, the 
smooth curve probably represents the total number of data 
more accurately than does either of the other two types. Just 
as i^ the case of a polygon, thi* area abov e any class interval 
is only by chance equal to the freciuency therein, but the whole 
area^^der the smooth frequency curve is equal to the whole 
nuinter of cases. Partly because' this form of curve does not 
repMent accurately the exact data upon which it is based, 
and partly because it is more difficult to draw well than either 
of the other types, it is the Iciist freciueiitly used of the three 
for representmg actual distributions. 

TABLE 111 


Four Ci^assifications of Same Dita with Diffebent 

- CUASS Intebv ALs 


Inlerval 
of Five 

1 Interval ! 

of Ten ! 

1 I nterval 

of Twenty 

Interval 
of Forty 

f 

/ 

/ 

f 

f 

170- 1 

85- 4 

170- 1 

160- 3 

160- 3 

165- 1 

80- 5 

160- 2 

140- 6 

120- 14 

100- 1 

7.5- 2 

150- 2 

120- 8 

80- 42 

155- 0 

70- 2 

140- 4 

100- 20 

40- 16 

150- 2 

65- 4 

130- 5 

80- 22 

0- 5 

14&- 2 

60- 2 

120- 3 

60- 10 

A7 - 80 

140- 2 

55- 3 

110- 8 

40- 6 

135- 2 

50- 1 

100- 12 

20- 3 


130- 3 

45- 2 

90- 13 

0- 2 


125- 1 40- 0 

120^- 2 35- 0 

115- 5 30-2 

no- 3 2rr- 1 

105 - 5 20-0 

lOO- 7 16-0 

95- 7 10-0 

90- 6 5-2 

.V - 80 

80- 9 

70- 4 

60- 6 

50- 4 

40- 2 

30- 2 

20- 1 

10- 0 

0- 2 

AT - 80 

N - 80 
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Effect of varying number of classes upon graphs. Under the 
topic of tabulation and classification in the previous chapter 
it was stated that in general there should be from ten to twenty 
classes in a frequency distribution, since if the number is much 
smaller than this the ongmal data are not accurately enou^ 



Scof« 

FIG 9. FOUR HISTOGRAMS REPRESENTING SAME DATA BUT 
WITH DIFFERENT CLASS INTERVALS 

The hutoeram at the bottom represents the data m Table III grouped by fives, 
the next by tens, the next by twenties, and the highest by forties. 

represented, and if it is much larger the distribution is too 
cumbersome. This point may well be illustrated by graphs, 
as has been done in Figure 9. This contains four histograms, 
all representing the same data, but with them grouped in 
classes of different widths. The four corresponding tabulations 
are given in Table III. The histogram at the bottom of the 
figure, which represents the data as grouped m the classification 
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by fives, contains numerous irregularities. The second from the 
bottom, based upon classes of ten rather than five, is much 
more regular, but there are still three irregular low places. 
Giwping by twenties as represented by the next histogram 
eliininates these low places and yields a comparatively regular 
figure. Fmally, that by forties, which is represented by the 
histogram at the top, is still more regular. However, if this 
histogram is compared with the one at the bottom it appears 
that the irregularities are undoubtedly much more smoothed 
out than is ordinarily justified, and that many of the features 
of the original distribution are lost. For as small a number of 
cases as eighty the third distribution, represented by the histo- 
gram next to the top, is perhaps the best, although the one 
immediately below it, representing the classification by tens, 
would probably be bett<‘r for large numbers of cases. Either 
one is generally better than the two extreme representations. 

Smoothing. An effect similar to that caused by lessening 
the number of classes is produced by smoothing ' This pro- 
cedure is justified only in cases in which the data are either too 
few to be truly representative of the total population from 
which they are drawn, or are subject to such errors that they 
are not representative thereof In general the result from 
smoothing may be thought of in the same way as was suggested 
for the smooth frequency cur\'e, as Ixnng representative of the 
total number of cases from which t hose actually measured were 
taken rather than of the latter thianselves Thus, for example, 
if m a lai^e city school system it is desired to determine the 
distribution of intelligence among all fourth-grade children, and 
it is possible to test only a selected sample of such children, the 
results from this sample may be smoothed to yield a better 
representation of those for all fourth-grade children. Occa- 
sionally smoothing is applied to a series of measures subject to 
variable errors of considerable size merely to yield a more 
nearly true distribution of scores for the same cases and not 
for a larger population. Considerable caution should be excr- 

' The method of smoothing is also sometimes called the method of mov- 
ing or rolling averages, 
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cised in determining whether or not to smooth a disthbotion, 
however, since significant features may be reduced or even 
totally eliminated by so domg. 

The most common method of smoothing data is to substiftlte 
for each frequency the average of it and the two adjacent fre- 
quencies, one on each side of it. Sometimes some other number 
than three, usually an odd number, is used, but three is mtub 
the most common. Figure 10 illustrates the method by showing 

Score j_ im f 
140 — 1 - 1 67 
130— 3- 3 67 
120— 7— 7 00 
110-11-10 67 
100-14-13 33 



These represent same data as do Figures 4, 7, and 8. 

the original frequency polygon already given in Figure 7, and 
the resulting frequency polygon * after the first smoothmg by 
the method of threes just desenbed. The last column of figures 
at the right shows the smoothed frequencies represented by the 
broken line in the figure. 

It will be seen that the rule stated above cannot be literally 
applied at the extremes of the distribution since there is no 
adjacent frequency below the lowest class or above the highest 
class of the distribution. In these two cases the accepted prao- 

* A Binootbed curve may be drawn in histogram or smooth frequency 
curve form, but that of the frequency polygon w most common. If the 
curve representing the actual distribution is given, both should be m the 
same form. 
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tice is to multiply the frequency therein by two and then add 
t^e frequency in the adjacent class, the sum being divided by 
tiiree. According to the method just described, the smoothed 
frequency for the 40- class is determined by multiplymg 1, the 
originai frequency in this class, by 2, which gives 2, adding 
to the frequency in the 50- class, which is 0, and dividing 
by 3, which gives .67. The smoothed frequency for the 50- 
class is determined by adding the frequencies m that and the 
two adjacent classes, that is, 1, 0, and 3, which gives 4, and 
dividing by 3, yieldmg a smoothed frequency of 1.33. For the 


60- dasB the smoothed frequency equals 


0 + 3 + 6 
3 


or 3, for 


the 70- class. 


3 + 6 + 9 
3 


or 6, and so on. 


From the graph it 


will be seen that the smoothed frequency polygon is more 
regular than the original one and tends to lower the highest 
points and raise the one markedly low point of the latter. 

Another method of smoothing has been described by Thur- 
stone,* but is not commonly employed. It differs from the one 
just described mjliat the onginal frequency m the class for 
which a 8mootM|mquency is being determined is doubled, then 
the two adjaceonKiluencies added, and the sum divided by 4. 
For the same dlt^pKtion just used in connection with Figure 10, 
this method yields ihe results shown in Table IV. This method 
makes it necessary to multiply by three instead of two at the 
extremes. Therefore the smoothed frequency for the 40- class 
is obtained by taking 3 times 1, adding 0, and dividing by 4, 
which gives .75. For the 50- class it equals 1 plus 2 times 0 
plus 3, which gives 4, divided by 4, or 1. For the 60- class 


it equals 


0+23+6 

4 


or 3; and so on for the other classes. 


A comparison of the results obtained by this and by the other 
method indicates that there is comparatively little difference. 
In the example given, the only difference as great as .50 is that 
between 12.67 and 13.25 m the 90- class, and in the eleven 
classes there are only three differences as great as .25. 

* L. L. Thuratone, The Fundamental* SUUtelict (New York, Macmillan 
Co., 1926), Ch. VI, “Smoothing the Frequency Polygon.” 
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TABLE IV 

First and Sbcond Smoothed Fbb- 
Q17ENCIES Obtained bt Method 
Recommended bt Thdhstone 


/ 

First Sm f 

Second Sm f 

140- 1 

1 50 

200 

130- 3 

3.50 

388 

120- 7 

700 

706 

110- 11 

10 75 

10 50 

KXl- 14 

13.50 

12 75 

90- 15 

13 25 

12 44 

80- 9 

9 75 

9 69 

70- 6 

600 

6 19 

60- 3 

300 

3.25 

50- 0 

1 00 

1 44 

40- I 

75 

81 

N = 70 

70 00 

70 01 


Occasionally tho process of smoothing is repeated and applied 
a second, a third, or even more tunes, but the justification for 
doing so occurs very rarely. More or less the same result that 
could be obtained by two or more smootUwB by threes is 
given by a single smoothing using some larM^pbiber of classes 
such as five or si'ven. Sometimes this latter j B ipd is advisable 
when in the data there are periodic fluctuaC^a that are irrele- 
vant to the problem being studied. Such flucraations are almost 
entirely limited to lime senes. For example, if pupils’ achieve- 
ments from day to day are measured for a considerable period 
of tune and plotted, it is often found that there tend to be drops 
on certain days of the week, in most instances on Monday and 
Friday Therefore to eliminate the fluctuations caused by con- 
ditions peculiar to these two days and to get a better picture 
of the general trend of achievement from week to week, smooth- 
ing by fives, since there are five school days in a week, is com- 
monly desirable. Similarly, if data given by months for a 
period of years are being handled, it may be desirable to smooth 
by groups of twelve to eluninate seasonal fluctuations and get 
a better representation of the yearly trend. 

It is always possible to smooth a curve by geometric or 
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graphic methods rather than by those of arithmetic. Although 
the writer believes that in general the method illustrated in the 
text is preferable to the graphic method, some readers may 
prefer to employ the latter. In the treatment by Thurstone 
just referred to he illustrates the graphic application of his 
method. A more comprehensive discussion, however, dealing 
with the graphic method in general as applied to various plans 
of smoothmg is given by McChesney.* 

Cumulative frequency curves. Although the terms cumula- 
tiee frequency curve and ogive or percentile curve are sometimes 

Cujn. 

Seora ^ _}_ 

140 - 1 70 


■s 


Score 

FIG. n. CUMULATIVE FREQUENCY CURVE SHOWING NUMBER 
OF CASES BELOW EACH POINT 

This curve represents the same data as do Figures 4, 7, 8, and 10. 

used interchangeably, it is better to distinguish between them. 
Both are representations of a cumulative frequency distribu- 
tion. The cumulative frequency curve represents such a dis- 
tribution drawn m accord with the usual practice of representing 
the number of cases by the vertical, or Y, scale and the mag- 
nitude of the variable measured by the horizontal, or X, scale. 
Although such a curve may be drawn in any one of the three 
ways described, for ordinary frequency curves it usually follows 

*Rutb McChesney, “The Graphical Conetruction of Moving Aver- 
ages,” Jffumdl of the American Statittical Attoctation, VoL 23, June, 1928, 
ap. 164-172. 
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the smooth form. Sometimes the so-called stairslep form, corre- 
sponding to the histogram, is employed, but the form corre- 
sponding to the frequency polygon is almost never seen. 

A cumulative frequency curve may begin at either end of 
the distribution, but usually at the lower end. Figure 11 iUus- 
trates such a curve for the same data as were used previoas^ 
for the histogram, polygon, and smooth curve. As waar «*- 

Cum. 

No. of 
Catei 

Jty 

to- 

Bty 

40 - 

aa 
20 
10 
0 - 

Scon 

FIG. 12. CUMULATIVE FREQUENCY CURVE SHOWING NUMBER 
OF CASES AT OR ABOVE EACH POINT 

Tbu curve represents the same data as do Fifuree 4, 7, 8, 10, and 1 1. 



plained in the discussion of the cumulative distribution, the 
frequency for each class represents the total number up to and 
including that class or, in other words, below the lower limit 
of the next higher class. Correspondingly for the curve, its 
height at any given point represents the total number of cases 
up to or below that point In Figure 11, since the lower limit 
of the lowest class is 40, the curve begins or rises from the base 
Ime at that point, thus showmg that there are no cases below 
40. At 50 it has a height of 1, thus mdicating that the distribu- 
tion contains one case below that point ; at 60 its height is still 
1 as there are no additional cases m the 50- class; at 70 it is 
4 since that is the total number of cases up to 70; and so on 
until it ends with a height of 70, the total number of oases, at 
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150, which is the lower limit of the next class above the highest 
one in the distribution. 

Figure 12 shows a cumulative frequency curve of the other 
tjrpe for the same data. It runs in a direction opposite from 
that in Figure 11, that is, it begins at the upper end of the dis- 
tribution and thus shows the number of cases at or above each 
point on the base line. It begins at 150, since there are no 
cases above that. At 140 its height is 1, because there is one 

cast^ m the 140- interval; at 130 
its height is 4, indicating that 
there are four cases at 130 or 
above; at 120 it is 11, and so 
on until it reaches the maximum 
height of 70 at 40, thus indicat- 
ing that all seventy cases in the 
distribution arc at or above 40, 
which is the lower limit of the 
lowest class. 

The ogive, or percentile curve. 

The ogive, or percentile curve, 
differs from the one just de- 
scnbed in that the scales are re- 
versed. In other words, the hor- 
izontal or A-axis is used to 

Nuintwr of Coms 

FIG. 13. OGIVE OR PERCENTILE *'PPJ‘vsent the number of cases 
CURVE and the vertical or F-axis, the 

Thu curve u the same as that in characteristic being measured, 
except that the axes are Although it is pOSSlble tO con- 
struct such a curve by begin- 
ning at either end of the scale, it is almost universal prac- 
tice to begin at the lower left comer of the graph, or, in 
other words, to construct it in a form corresponding to the 
cumulative frequency curve shown m Figure 11, so that it 
indicates the number of cases below each point. Such a curve 
for the same distribution is shown in Figure 13. It is to 
be interpreted in the same way as that in Figure 11 except 
that the directions are interchanged. Thus, for example, the 




GRAPHICAL REPRESENTATION 


fact that the curve is four units to the right of the y-axis at 
a height of 70 indicates that four cases fall below 70, just as is 
shown by the curve in Figure 11, which has a height of 4 at 70. 



FIG. 14. OGIVE OR PERCENTILE CURVE WITH CERTAIN 
PERCENTILE LINES 

Thu is tbo aamo cur>*e os in Figure 13 with acveral percentile lines added 

The reason that the term percertlile curve or percentile graph 
is frequently employed instead of ogive is that it is commcHi 
practice to lay off the horizontal scale in terms of percentiles 
as well as in terms of actual numbers of cases, or perhaps in- 
stead of the latter. Moreover, it is common practice to draw 
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Parcantil* 

A 10 20 30 40 SO 60 70 80 90 100 
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46 


31 ; 


a number of vertical lines at various percentile points, such 
as the even tens, the twenty-fifth and seventy-fifth, and so 
forth. Their purpose is to show graphically the scores or meas- 
ures corresponding to the given percentile points and thus to 
assist in interpreting the curve. In Figure 14 the curve in the 
previous figure has been reproduced with the addition of a 
percentile scale on the horizontal axis and of vertical lines at 

each tenth percentile 
and also at the fifth, 
twenty-fifth, seventy- 
fifth, and ninety-fifth. 
Also, horizontal lines 
have been drawn in to 
aid the eye in determin- 
ing the vertical dis- 
tances at given points. 
From the graph it can 
easily be determined 
that the fifth percentile 
of the given distribu- 
tion, for example, is 
about 68, the tenth per- 
centile about 75, the 
twenty-fifth about 88, 
the fiftieth about 100, 
and so on. 

Such a graph as that 
just given is frequently 
provided to assist in the mterpretation of scores upon standard- 
ized tests. Ordinarily such a graph contains a curve representing 
the distribution of scores from a large number of cases. The 
teacher or other person employing the same test then draws upon 
the graph another percentile curve representing the distribution 
of the particular group of pupils tested. By comparing the two 
curves it is easy to determine how the group in question com- 
pares with pupils in general. To illustrate this. Figure 15 has 
been prepared. The solid curve therein represents the dis- 
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FIG. 16. OGIVE OR PERCENTILE 
CURVES USED TO COMPARE TWO 
DISTRIBUTIONS 

The solid curve repreeente the distribution 
of intelligence test scores of a large group of 
pupilB and the broken curve that of the pupils 
from a amgle school 
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tributioD of the intelligence test scores of a large number of 
pupils from many schools and the broken line that of the pupils 
in a particular school. Only a percentile scale is shown, since 
it would be somewhat awkward to represent the two different 
scales for the different numbers of cases m the two distributions. 
It will be seen that the fiftieth percentiles or medians of the 
two distributions are practically the same, but that the 
centiles near both extremes are nearer the median in the ca» 
of the larger distribution than in that of the smaller. In other 
words, although the two series of scores average about the same, 
that from the single school contains larger proportions of both 
high and low scores than does that for all schools combined. 

Exercises 

1. Construct the coordinate axis system and show the location of 
each of the following points thereon .4(4,2), 5(-l,5); C(-2,-3); 
D(3,0),£,U-3):F(-1,-1). 

2 Construct a histogram, a frequency polygon, and a smooth fre- 
quency curve for each of the following distnbutions: 


A 

/ 

B 

/ 

100- 2 

12- 

2 

95- 3 

11- 

0 

90- 5 

10- 

4 

85- 8 

9- 

6 

80- 16 

8- 

3 

75- 22 

7- 

7 

70- 17 

6- 

11 

65- 14 

5- 

16 

60- 9 

4- 

10 

55- 4 

3- 

8 

50- 1 

2- 

3 

45- 1 

1- 

1 

N = 102 

N = 

71 


3. Construct a histogram to show the exact score of each of the 
following pupils- A, 78, 13, 91 , C, 74, D, 83, E, 89, F, 72, G, 95; H, 85; 
I, 82; J, 88; K, 62, L, 83, M, 74, N, 96, 0, 70; P, 66, Q, 87, R, 90; S, 77; 
T, 84. 

4. Smooth the two senes given in Exercise 2 by groups of three and 
draw the smoothed frequency polygon for each along with the onginai 
polygon. 
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' 5. Make a second smoothing of the series in Part A by threes. Also 
IBake a first smoothing by groups of five, and a smoothing by the 
method given on page 44. Draw the polygons representing the three 
smoothings all on the same figure. 

6. Construct both cumulative frequency curves for Parts A and B 
of Exercise 2. 

7. Construct an ogive or percentile curve for each distribution in 
Exercise 2. Draw in the Imes for each tenth jiercentile 

8. Draw the ogives for the two di.stributions given below on the same 
figure and put m the fifth, tenth, twenty-fifth, fiftieth, seventy-fifth, 
nine tieth, and ninety-fifth percentde lines. 



/. 

/. 

140- 

2 

1 

130- 

6 

3 

120- 

8 

6 

110- 

3 

7 

100- 

9 

10 

90- 

12 

14 

80- 

16 

17 

70- 

21 

23 

60- 

18 

34 

50- 

15 

26 

40- 

11 

19 

30- 

7 

12 

20- 

6 

7 

10- 

2 

3 

0- 

1 

2 

II 

Nt = 184 



CHAPTER IV 

THE NORMAL AND OTHER FREQUENCY CURVES 

The normal frequency curve. The normal frequency dis- 
tribution IS the one that moat commonly results when ediMMb- 
tional and other biological data are tabulated. Therefore its 
graphic representation is of high importance. It is best known 




FIG 10 NORMAL FREQUENCY CURVES 


as the norma/ frequency curve, the normal probability curve, or 
simply the normal curve, although sometimes other names, such 
as the curve of error, the ti'aussian curve, and so forth, are applied 
to it. It IS a symmetrical, bell-shaped cun e, high in the center, 
decreasing m height rather rapidly near the center, and then 
more slowly Theoretically it does not touch the base line until 
infinity is reached, but it approaches it so closely that in a 
drawmg of ordinary size it is impossible to show that it does 
not touch it beyond a moderately great distance from its peak 
or highest point. It may be illustrated by the two cun'es in 
Figure 16, both of which are normal, the difference being merely 
that different vertical scales are used, one being twice the other. 

53 
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The fact that the normal distribution is the one that most 
commonly occurs should not be interpreted to mean that an 
exactly normal distribution is secured if ordinary educational 
or biological data are tabulated. It does mean that if a reason- 
ably large number of measures of some trait or characteristic 
are tabulated they will m most cases approximate a normal 

IQ. f 
131- 32 
126- 186 



FIG. 17 GRAPHIC REPRESENTATION OF INTELLIGENCE QUO- 
TIENTS OF OVER ELEVEN THOUSAND HIGH SCHOOL 
GRADUATES. WITH BEST FITTING NORMAL CURVE 


distribution, and, therefore, their graphic representation will 
approxltaate a normal curve The closeness of this approxima- 
tion depends largely upon the adequacy of the sample, the use 
of a scale of measurement divided into fine enough units, and 
the absence of errors from the measures secured. To illustrate 
how nearly actual distnbutions of the type of data referred to 
approximate normal distributions, three distributions and the 
smooth frequency curves representing them will be given. 
TTiat in Figure 17 represents the intelligence quotients of over 
eleven thousand high-school graduates. ‘ To show how nearly 
* Charles W. Odell, “Are College Students a Select Group?” Univertily 
ef lUtnois BvUeltn, Vol. 24, No 36, Bureau of Educational Research Bul- 
letin, No 34 (Urbana, University of iUinoiB, 1927), pp 19-22 
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the curve approaches normality, the normal curve which best 
fits the actual curve * has also been included in the figure. It 
will be seen that in this case the approximation to normality is 
very close. 

Figure 18 is similar to Figure 17 except that the curve therein 
represents the intelhgence quotients of the seniors from a 
single school included among those wherem the more than 


LS: J- 



FIG 18 GRAPHIC REPRESENT ATION’OF QUOTIENTS OP GRADU- 
ATES FROM ONE HIGH SCHOOL WITH BEST FITTING 
i NORMAL CURVE 

eleven thousand students were enrofied. It will be q^n that, 
although it tends to approach the normal curve, it does not 
approximate it So closely as does that in the previous figure. 
The chief cause of this difference is probably that the number 
of semors in the single high school is so much smaller than the 
number represented in Figure 17 that it constitutes a mudi 
less adequate sampling of all high-school seniors. 

As a third illustration Figure 19 is given The curve in it 
represents the test scores of a group of fifth-grade children. 
The number included is somewhat greater than the number of 
seniors from the single School, and probably because of this, 

*The method of constnicting a best fitting normal curve for an actual 
distribution is described in Chaotrr XXI. 
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the curve more nearly approximates the normal curve than 
did the former one. 

It has been found that variable errors, that is, errors due to 
chance inaccuracies and not to a constant bias,’ also tend to 
group themselves so as to form normal curves. Furthermore, 
a matter of chance such as tossing coins yields a very close 
approximation to the normal curve. For example, if ten coins 
are tossed a number of times and the numbers of heads and 
tails at the different tosses recorded and tabulated, the senes 


Score ( 
95- 1 



FIG 19, GRAPHIC REPRESENTATION OF TEST SCORES 

Teat 8coro6 of a group of pupils in thi- fifth grade with boat fitting normal 

curve 

will not vaiy far from normal The largest number of tosses 
will probably result m five heads and five tails, the next largest 
numbers in four heads and slx tails and six heads and four tails, 
and so on to the least, which will be all heads or all tails. As 
anyoQ&familiar with the laws of chance knows, the expansion 
of gives the most probable frequencies of occurrence 

<rf possibility. Since there are ten coins in the example, 
the most probable distribution in that case is obtained by ex- 
panding the binomial to the tenth power. If there were five 
coins the fifth power would be used, if eight the eighth, and so 
on. The greater the power to which the binomial is expanded, 
the more nearly does its graphical representation approach a 
smooth normal curve In fact, the normal curve may be thought 

* A fuller explanation of variable errore may be found in Chapter XIX. 
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of aa the representation of the binomial, with the two terms 
equal, raised to the infinite power. One of the easiest ways to 
draw a normal curve is to plot the expansion of the binomial 
to a moderate power, perhaps the sixth or eighth, and then 
sketch in the smooth curve that best fits the figure. If the 
binomial expanded is the total area under the curve is 1. 

The equation of the normal curve is most commonly seen in 
one of the two following forms. * 

iV — 

y = and y = 

The yo m the first formula refers to the maximum ordinate, 
that IS, the ordinate whc're the height of the curve is the greatest. 
This point is at the middle, which, of course, is at the origm. 

N 

As is evident by companng the two formulae above, j/„ = — 

ffv2jr 

The term c is 2 71 83-, the base used in calculatmg Napierian 
logarithms; x, as usual, refers to the distance from the K-axis, 
measured parallel to the X-axis; N has its regular meaning, 
the total number of cases; <r (sigma) is the standard deviation ^ 
of the distribution, tt is 3 1416-, the ratio of the circumference 
to the. diameter of a circle. 

To illust rate the construction of a normal curve by the use 
of the binomial expansion. Figure 20 is given. In it the ex- 
pansion of (1 + 1)' has lieen represented by a frequency polygon 
and the best fitting smooth curve, which is normal, drawn m. 
In this figure the bast»-line or horizontal scale represents the 
various terms in the expansion, which are seven m ttalLauM, 
smee (1 D* = 1 + 6 -b 15 + 20 + 15 -1- 6 + 1. The®^ 
scale indicates the values of the various terms. Only nsMpEiid 
peak of the figure is the difference between the polygon and the 
smooth normal curve of any appreciable size. The areas of 
the two are exactly the same. 

‘The expression VSt “ 2.5066+. 

‘The standard deviation is a measure of the scatter or spread of the 
measures in a distribution about their average It is frequently used as a 
base-line unit For a detailed discussion of a see Chapter VII. 
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. If tables such as those given in Appendix B are at hand, it 
ill easy to construct a normal curve by a different method. To 
do BO the base-line scale is first laid off so that 0 is at its center. 
The unit for this scale is usually either the standard or the 
median deviation.* A scale for height is chosen so that the 
maximum ordinate, or, in other words, the greatest height of 
the curve, is suitable and convenient. A few points, usually at 
equal distances from one another, are marked off upon the base 

1 

20 
16 
12 
8 

4 

■ 4 . 


FIG. » FREQUENCY POLYGON AND SMOOTH CURTS 
^REPRESENTING EXPANSION OF (I + l)‘ 

The smooth curve is normal in shape 

line and the distance of each from the origin looked up m the 
first column of the table. The corresponding entry in the second 
column of the table is the height of the ordinate to be erected 
there, expressed in terms of the ma.\imum ordinate. An ordinate 
of the proper height is next drawn above each of the base-line 
points or merely a dot is placed at the correct distance above 
each The normal curve is then drawn through the tops of 
the ordinates or through the dots, as the case may be. 

This process of drawing a curve is illustrated by Figure 21. 
The base line in this figure has been terminated at Sir from the 
origin in each direction and points taken on it at a distance of 
.25a from one another. The maximum ordinate, or that at 
the center of the curve, has been taken as equal to 5 units. To 

• The median deviation (MdD), often called the probable error (PE), is 
nnular to the standard deviation in that it is a measure of spread or scatter 
about the average. In a normal distribution it is equal to approxiinately 
.6745ff. 
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the right of the curve are shown the values of Y oorrefqmnding^ 
to the values of X, that is, the height of the curve above eaoli^ 
of the points taken on the base line. Thus, by finding in Appen- 
dix B the height given as corresponding to a a distance of .25, 
the value of X corresponding to .250 is seen to be .9692; suni- 
larly that corresponding to .5ff is seen to be .8825, and so on. 
In the present case each Y value so obtained must be multiplied 
by 5, since that is the height of the maximum ordinate. The*®* 


£_ Haight 



FIG 21 NORMAL FREQUENCY CURVE CONSTRUCTED BY 
USE OF VALUES GIVEN IN APPENDIX B 

fore the ordinates at a di.stance of .250' from 0, or the maximum 
ordinate, are 5 X .9692, or 4 8460, high , those at .5o are 
5 X 8825, or 4 4125, high, and so on. 

In the construction of a normal curve by this method any 
desired fraction of the standard or median deviation may be 
used instead of 25, as in this case. The smaller the fraction, 
the easier it is to draw in the curve exactly. It is helpful to 
take the points closer together near the middle, where the slope 
changes most rapidly, since that portion is usually the most 
difficult to draw. If one uses a distance betwt>en points of .l<r 
near the center and of .25<r elsewhere, the cun'^e is very easy 
to draw with a high degree of accuracy. For most purposes, 
however, a distance of .25a near the center and of .5a elsewhere 
gives sufficient exactness ’ 

’ The loss in accuracy due to using points rather far apart is not in any 
way due to their lieing inaccurately located, but merely to the greater 
difficulty of drawing an accurate smooth curve through them. 
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Other symmetrical curves. In addition to the normal fre- 
quency ciuve there are several other types of symmetrical 
curves, that is, curves pf which the two halves are alike, more 

or less frequently encoun- 
tered in working with educa- 
tional data. For such curves 
that have the general char- 
acteristic of being high at 
the center and low at the 
two extremes, a triple classi- 
fication on the basis of what 
IS called kurtosis has been 
made Kurtosis may be de- 
fined as the degree to which 
measures tend to be grouped 
or bunehi'd closely around 
the a\-erage or highest point 
of the curve, or to be scattered away from it The term meso- 
kwrttc, meamng moderately bunched, is applied to a normal 
curve. If a curve is 
flatter or less bunched 
around the average 
than a normal curve, 
it is called plalykur- 
hc. One that is more 
peaked, or has the 
measures more 
bunched around the 
average, is called lep- 
tokurtic. The latter 
two types are illus- 
trated in Figure 22 in 
which the upper curve 


FIG 22 LEPTOKURTIC AND 

platykurtic frequency 

CURVES 

The upper curve is lept/ikurtic, the lower 
platykurtic 



FIG 2,'! 


80 90 

Scon 

PLATYKURTIC FREQUENCY 
CURVE REPRESENTING SCORES 
ON AN INTELLIGENCE TEST 

This represents the scores made by ItB pupila 
upon a 120 iiomt test. 


is leptokurtic or more peaked than the normal and lower 
platykurtic or less so.* 


*The method of computing kurtosis involves measures not yet m- 
plained, therefore it is not presented here but tdh be given in Qiapter XXIl. 
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Distributions and curves that are platykurtic and leptokurtic 
in form are occasionally encountered in the handling of educar- 
tional data. The former type, for example, is usually produced 
by the ages of the pupils in a number of consecutive grades. 
Although those in each grade form a distribution more or less 
normal, when a number of grades are put together the dis- 



FIG 24 LEPTOKURTIC FREQUF.N’CY CURVE REPRESENTING 
SCORES OK A CL.ASS UPON A TEST 

This roprese'its the scores of forty-six students upon a fifty point teat 


tribution becomes decidedly flattened To illustrate such a 
curve, Figure 23 has been insertt*d. It contains a curve repre- 
senting the scores of a group of over one hundred pupils upon 
an intelligence lest. The distribution and resultmg curve are 
not exactly symmetrical, but nearly enough symmetrical to 
illustrate the point. 

An example of a leptokurtic curve is shown in Figure 24. 
This represents the scores made by a class of forty-six university 
stud^^ iipon a fifty-point test. The shape of the distribution 
is un<i&btedly due to the fact that upon this test almost one- 
half' of the items were decidedly easy for a majority of the- 
manbera^ of the class, and that most of the other half were 
deckl^dll^ hard, so that a large proportion of the class was 
ratto i®Saely bunched together, with only a few of the poorest 
atudeatg failing on any of the easier items and, therefore, making 
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scores much below the average, and only a few of the brighter 
ones responding correctly to any of the harder items and, 
therefore, making scores above the average. 

It Another type of symmetrical curve that occurs occasionally, 
although less often than any of those previously mentioned, 
in educational work, is the U curve, so called because its shape 
resembles that letter. Figure 25 contains an ideal representa- 
tion of such a curve. A situation in which for some reason or 
other the cases measured tend to be either high or low and 

not average yields an ap- 
proximation to such a 
curve. For example, if 
a school system maintams 
special rooms for the pur- 
pose of giving individual 
help to pupils whose men- 
tality IS either so infenor 
that they need special as- 
sistance because they arc 
not able to do ordinary 
work, or so superior that they should be giv(>n unusual oppor- 
tunities for doing more work or gaming time, a tabulation of 
the I.Q.’s of the pupi^ in these rooms tends to approach this 
shape. 

Another type of g^minetncal distribution sometimes en- 
countered is the rectangular Since the form of this is eadly 
understood, being merely a rectangle, no figure will be included 
to illustrate it. It will be seen that such a distribution is com- 
posed of classes having approximately the same number of cases 
in each. For example, if the average number of pupils to the 
teacher m the different elementary grades of a school system is 
plotted, it ordinarily approximates this form, smee there is 
usually little difference from grade to grade. 

Non-cymmetrical curves. The most common t 3 rpe of non- 
symmetncal or asymmetrical curve, that is, curve in which the 
two halves are not sunilar, is what is usually called the skew 
curve. It may be thought of as a normal curve which has been 
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pulled out to one side or the other. If it has been pulled out to 
the right so that the end of the curve at the right or upper 
of the scale is farther from the highest point than is the end 
at the left, it is said to be positively skewed or to possess plus 
skewness. If it has been stretched out m the opposite directi^m, 
it is negatively skewed or possesses minus skewness. Figure 26 


FIG 26 POSITIVELY AND NEGATIVELY SKEWED CUEVEa 

The curve at the right ib negatively akewed. that at the left positively 

skewed 

illustrates the two types of curves, the one at the ng^t being 
negatively skewed and that at the left positively skewsd.* 
Skew curves are fairly commonly encountered in dealing 
with educational data. They often result from the influence of 
some factor that more or leas arbitranly cuts off the distribu- 
tion at one end or the other. For example, in a school system 
m which pupils are ordi- 
narily not permitted to 
enter Grade I until they 
have reached the age of 
six, there will ordinarily 
be found in that grade a 
vsafy few five-year-olds, a 
large number of six-year- 
olds, some seven-year-olds, 
a few eight-year-olds, and 
perhaps a very few above skewed 

that age. If this situation 

is represented graphically, a positively skewetl curve, that is, 
one pulled out to the right or upper ages, will result 
The most extreme form of a skew cun^e is sometimes known 

•The methods of computing skewness involve measures not yet ex- 
plained, therefore they are not presented here but will be given in Chap- 
toXXII 
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as a J curve from its resemblance to the shape of that letter. 
Such a curve is one in which the peak is at one end of the 
distribution or, in other words, one that is so skew that 
there are no cases on one side or the other, as the case may 
be, of the peak. Figure 27 represents a positively skewed 
J curve. A negative one would, of course, be similar except re- 
versed. 

Curve-fitting. In addition to the curves already mentioned, 
other tsTies are sometimes encountered Various schemes of 
curve-fittmg, that is, of determining the type of curve which 
best represents an actual distribution, have been proposed. 
Pearson, the English statistician, has classified frequency curves 
into seven varieties, and by computing certain constants for 
a given distribution, one can determine to which of the seven 
types it belongs. Other methods of curve-fitting mvolve the 
use of the method of least squares, higher-degree equations, 
portions bf hyperbolas, and so forth. Since the ordinary edu- 
cational worker has little or no occasion to make use of these, 
however, they will not be discussi'd further here. The reader 
who is interested may find something concerning them in the 
references given below.*” The method of fitting a normal curve 
to a given distribution is more friKiuently useful and therefore 
will be explained Hi Chapter XXI 

ExERaSES 

1. Draw a smooth frequency curve representing the expansion of 

(1 + !)'• 

2. Construct a normal frequency curve with a maximum ordinate 
of four inches and a standard deviation of one inch. 

3. Draw a smooth frequency curve representing each of the following 
distributions, and state which of the types of curves mentioned in this 
chapter it most nearly resembles 

“ Karl J. Holzinger, Statistical Methods jar Students in Education (Bos- 
ton, Gum and Co , 19^), Ch xvi, ‘‘The Elements of Curve-Fitting ” 

Truman L. Kelley, Statistical Method (New York, Macmillan Co., 
1923), Ch. vu, “The Ihttmg of Curves to Distributions ” 

H L Rietz and others, Handlmok of Mathematical Statistics (Boston, 
Houghton Mi£9in Co., 1924), Ch. iv and pp. 103-119. 
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A 

/ 

3000- 2 
2800- 4 
2600- 8 
2400- 11 
2200- 13 
2000- 17 
1800- 24 
1600- 22 
1400- 20 
1200- 16 
1000- 13 
800- 9 
600- 10 
400- 5 
200- 3 
0-_l 
N = 178 

F 

/ 

20 - 6 
18- 5 
16- 7 
14- 8 
12- 4 

10- 5 
6 - 6 
6 - 6 
4- 3 
2- 7 
0-_4 
N = 61 


B 



/ 

110- 

15 

105- 

11 

lOO- 

14 

95- 

10 

90- 

8 

85- 

6 

80- 

2 

75- 

1 

70- 

4 

65- 

7 

60- 

9 

55- 

10 

50- 

14 

45- 

16 

40- 

17 

iV = 144 


G 

/ 

95- 1 
90- 4 
85- 9 
80- 12 
75- 15 
70- 13 
65- 11 
60- 7 
55- 8 
50- 5 
45- 2 
40- _2 
N = 89 


C 

/ 

12 - 12 

11- 14 
10- 15 
9- 20 
8- 28 
7- 28 
6- 29 
5- 34 
4- 32 
3- 36 
2- 38 
1- 45 
N = m 


H 

/ 

550- 2 

500- 6 

450- 13 
400- 42 
350- 111 
300- 195 
250- 220 
200- 115 
150- 39 
100- 15 
50- 8 

O- _1 
N = 767 


D 

/ 

150- 1 
140- 0 
130- 2 
120- 5 
110 - 8 
lOO- 13 
90- 15 
80- 20 
70- 19 
60- 16 
50- 12 
40- 9 
30- 5 
20 - 1 
10 - 1 
0-_l 
iV = 128 

I 

/ 

13- 45 

12- 52 
11- 37 
10- 28 



6- 5 
5- 0 
4- 1 


N = 215 


E 

/ 

45- 

1 

42- 

0 

39- 

2 

36- 

6 

33- 

8 

30- 

14 

27- 

15 

24- 

17 

21- 

16 

18- 

13 

15- 

9 

12- 

7 

9- 

6 

6-. 

2 

3~ 

3 

0- 

1 

AT * 120 

{ 

J 

/ 

20-6- 

2 

20-0- 

3 

19-6- 

7 

19-0- 15 
18-6- 22 
18-0- 31 
17-6- 24 

17-0- 

17 

16-6- 

10 

16-0- 

4 

15-6- 

2 

15-0- 

1 


^ = 138 



CHAPTER V 
AVERAGES 


General discussion. Just as a lar^e number of cases cannot 
be carried in mind separately but must be grouped to be com- 
prehended, so it is frequently advantageous to carry summariza- 
tion further and to use some one or a few numerical expressions 
to summarize a whole distribution. In general there are three 
tsqies oLmeasures or facts that are necessary to the summariza- 
tion or j|||Dription of a distribution, with sometimes a fourth. 
The mlii^nportant of these is an average or measure of cen- 
tral tendency, that is, of the point on the scale about which 
the measUnes tend to group themselves. The second measure 
needed is one of the variability, scatter, spread, or dispersion 
ef the measures around the central tendency. The third is of 
the reliability of these two and of any other measures obtained. 
The fourth, which can be found only in case the relationship 
between two senes of measures or sets of data is concerned, is 
a measure of the correlation or relationship existing between 
the two sets of measures, that is, of the extent to which the 
corresponding measures in the two series vary together. This 
chapter will deal with measures of the first t3q)e mentioned, or 
averages. 

The term average is best used as a general term. An average 
is a value of a variable that typifies the whole distribution, 
that is, a value about which the individual cases that compose 
the distribution tend to cluster It should be thought of as a 
value or pomt upon the scale of measurement employed and 
not as an actual case or measure. It may coincide with one or 
more particular cases, but when it does so the coincidence is 
only accidental. 

Of the averages or measures of central tendency known to 
statisticians, some five or six are encountered frequently enough 
in connection with educational data that they will be explained 

66 
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and the methods of computing them given in this chapter. 
These are the mean, the median, the mid-score, the mode, the 
geometric mean, and the harmonic mean. Of these the first 
three are much more commonly employed than the last three. 

The mean. Mean, sometimes arithmetic mean, is the statis- 
tical term for what, in the language of elementary arithmetic 
and of daily life, is known as the average, or sometimes as the 
arithmetic average, that is, it is the sum of a group of measures 
divided by their number. Its formula may be stated thus: 

XX 

M = In this M stands for the mean ; 2 (capital sigma) is 

the symbol for summation ; and X is used to refer to the variable, 
that is, to the thing being measured. N, as always. jRfers to 
the total number of cases. 

In accordance with the definition just given, thP^ffdinary 
method of determining the mean is very simple in theory, al- 
though it may involve much work. It is merely V add the 
measures or quantities that enter into it and divide their sum 
by the number of measures. To illustrate this, if the scores of 
the forty pupils in terms of words spelled correctly, already 
used on page 18 and elsewhere, are added, the total is found 
to be 2291, and if this is divided by forty, a mean of 57.276 is 
obtained. To do this, however, involves adding the forty scor^ 
which for most persons means previously arranging them in a 
column. Although such a proce^ia not very laborious wh^ 
only a few cases are concerned,- when the number is large it 
requires considerable time to early through. 

Probably the first step that would occur to anyone to shorten 
the process would be that instead of wntmg each score 
arately, one should group to^thei; scores having the sjbe 
value. In the given senes, however, there are only five scores, 
66, 62, 66, 68, and 72, which occur more than once, and only 
one of these occurs as many as three times, therefore doing 
this would shorten the process very httle. The usufd method 
employed to save labor in computing a mean from a large 
number of cases is to make use of a grouped distribution even 
though so doing sacrifices something of the accuracy possible 
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when exact scores are employed. In connection with such a 
distribution the so-called short method of computing the mean 
is employed. To make this clear two preliminary steps will 
be shown and then the short method itself. 

TABLE V 

Computation of Mean of Meas- 
ures IN FREQiiENrr Distri- 
bution BY Long Method 


/ 

A' 

75- 3 

232 5 

70- 5 

362 5 

65- 6 

405 0 

60- 6 

375 0 

5.5- 6 

345 0 

50- 4 

210 0 

45- 2 

95 0 

40- 2 

850 

35- 3 

1125 

30- 1 

32 5 

25- 1 

27 5 

20- 1 

225 

N « 40 

12,30.5.0 

M = 57 625 


Table V illustrates the first step toward the short method. It 
contains three columns of figures, of w hich the first two represent 
the classification of the forty scores in groups of five and are just 
the same as have already been given on page 21. The third col- 
iimn , headed fX, contains the products resulting from multiply- 
ing the mid-point of each class by the frequency m that class. 
Since one assumption underlying grouping is that the measures 
withm a given class are symmetrically distnbuted about or con- 
centrated at the mid-point of that class, this mid-pomt is taken 
as the best representative value of the measures therein. Thus 
the mid-pomt of file 75- class, which is 77.5, is multiplied by the 
frequency in that <^as8, 3, and the result, 232.5, entered in the 
column headed fit- Similarly for the 70- class, its mid-point, 
72.6, is multiplied its frequency, 5, and the result, 362.5, 
placed in the fX (bliimn. A similar multiplication is carried 
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out for each class and then the sum of the fX column is found, 
in this case 2305.0. This is divided by the number of cases, 40, 
giving 57.625 as the value of the mean. 

If the value just given is compared with the 57.275 already 
secured from the ungrouped scores, it is seen that the difference 
IS 350 However, the two are really not directly comparable. 
In adding the single scores each is considered as being exactly 
what it purports to be, whereas in dealing with the grouped 
distribution each is considered as the mid-point of a distance 
on the scale extending from the obtained score up to the next 
higher one. In other words, one-half of a unit should be added 
to the mean derived from the single scores to make it compa- 
rable with that from the grouped scores. Domg this gives 
57.275 + .5 = 57 775, which differs from 57 625 by only .150 
or about one-fourth of one per cent of the mean itself. For 
most purposes a difference of such slight magnitude may be 
considered negligible. It should also not be overlooked that 
if the number of cases were latter it is probable that the dif- 
ference would be still smaller. 

Although the method just illustrated is m certain respects 
shorter than adding the forty individual scores and dividing 
by 40 to secure the mean, the numbers dealt with are still just 
as large as in that method. It is possible, however, to reduce 
them as shown in Table VI. The first two columns therem are 
the same as in Table V. Following these is a third column, 
head d, standing for deviation or difference. The entries in 
this column are based upon an assumption or guess as to where 
the mean lies. It is assumed to be at the mid-pomt of some 
interval, generally the one m which it appears most probably 
to he. This is usually best, since the numbers involved in the 
imilting computations are reduced to a minimum. However, 
if one fails to guess correctly and does not take the assumed 
mean m the same class m which the true mean is later found 
to be, no error results. In the example ||tven, the mean is 
assumed to be at the mid-pomt of the 55^ class, that is, at 
57.5. This class, as is customary, is indit^UlKl by drawing a 
pair of horizontal lines, one immediately and the other 
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immediately below it. It is called the zero class, and a zero 
entered in the d column for it. This indicates that the deviation 
or difFerence of this class from the one in which the mean is 
assumed to be is zero. 


TABLE VI 

Compdtation of Mean of Measttbeb in 

F^QUENCY DlSTRlBXmON BY PAR- 
TIALLY Shoktened Method 


/ 

d 

fd 

75- 3 

-f-20 

+ 60 

70- 5 

4-15 

-t- 75 

65- 6 

-t-10 

-1- 60 

60- 6 

-1- 5 

+ 30 

55- 6 

0 

-1-225 

50- 4 

- 5 

- 20 

45- 2 

-10 

- 20 

40- 2 

-15 

- 30 

35- 3 

-20 

- 60 

80- I 

-25 

- 26 

25- 1 

-30 

- 30 

20- 1 

-36 

- 35 

N - 40 


-220 


'-*■ 40( +5~^fd 

***■ + 125 


Am M — 57 5 
M - 57.625 


The other entries in the d column have corresponding mean- 
ings for their respective classes, and may be filled in by pro- 
ceeding up and down respectively from the zero class, the first 
entry in each direction being equal to the width of the class 
interval, in this case five, the second entry to twice that width, 
hwe ten, the third to three times it, fifteen, and so on. The 
entries for the classes in which larger measures lie, ordinarily 
upward from the zero class, are positive, and those for the 
classes in which smaller measures lie, ordinarily downward, are 
negative. Thus in the example given, the +5 opposite the 00- 
class indicates that this class has a deviation of five points 
upward from the 55- or zero class, the -f-lO opposite the 65- 



AVERAGES 


71 


class means that it has a deviation of ten points upward, ai^ 
so on. Similarly the —5 opposite the 50- class indicates that 
it deviates five points downward, the —10 opposite the 45- 
class shows that it deviates ten points downward, and so on. 

In the fourth, or fd column, are given the products of each / 
and its corresponding d. Thus for the 75- class /d = 3 X 20 = 
60; for the 70- class it is 5 X 15 = 75; and so on. It will readily 
be seen that all the entries in the fd column for the classes 
above the zero class are positive and all those for the classes 
below it are negative. The fd column is then summed alge- 
braically. This 18 ordinarily done as shown m the example, 
the sum of the upper or positive portion of the column being 
entered beneath it in the space between the horizontal lines,* 
the sum of the negative portion of the column being entered 
at the bottom, and the algebraic sum of the whole below that. 
In this case the sum of the positive fd’s is 225, and that of the 
negative /d’s, 220, so that when their algebraic sum is taken 
it 18 +5. In other words, 2/d = +5. This is then divided by 
40, the number of cases, giving +.125, which represents the 
error involved in the assumption that the meaa, w 57.5, or, in 
other words, is the difference between the a^med mean and 
the true mean. Since this differenfliiv positive, it is added to 
the assumed mean, 57.5, thus giving a true mean of 57.625, 
as was obtained by the previous method. 

One further and final abbreviation of this method may still 
be made. This is shown m Table VII, which represents the 
short method of computation, the one to be employed ordina- 
rily.* This differs from the method just explained in that the 
entries in the d column show the deviations or differences in 
terms of class intervals and not of actual umts. A mean is 
assumed, the horizontal lines drawn, and a zero entered in the 
d column for the class in which the assumed mean is taken 

‘ Since the d value between the horizontal hnes is always zero, the fd 
value oorreeponding to it is also zero, and thus there is no need for entering 
it in that column 

' The reader should keep in mind that the two methods just described 
are not included for actual use in computing the mean, but merely to 
show the steps leading up to the short method. 
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TABLE VII 

SbOBT MxTHOD of CoMPCTINa Mkan of 
Measttrgb in Frequency 
Distribution 


f 

d 

fd 

75- 3 

-i-4 

+ 12 

70- 5 

-1-3 

+ 15 

65- 6 

-1-2 

+ 12 

60- 6 

-1-1 

+ 6 

65- 6 

0 1 

4-45 

50- 4 

-1 

- 4 

45- 2 

-2 

- 4 

40- 2 

-3 

- 6 

35- 3 

-4 

-12 

30- 1 

-5 

- 5 

25- 1 

-6 

- 6 

20- 1 

-7 

- 7 

N - 40 


-44 


40 1^ - 2/d 
f =■ + 025 
t - 5. 
n = + 125 
Ass M = 57,5 
M - 57 625 


as explained above The other entries in this column are then 
made merely by beginning with 1 in each of the two classes 
next to the zero class and entering the successive integers from 
1 on in the other classes. As before, the entries, or d values, 
for the classes contaimng the larger measures are positive, and 
those for the classes containing the smaller ones, negative. 
Thus in the example the d entry for the 60- class is +1, m- 
dicating that it is the first class above the zero class; that for 
the 65- class is +2, indicating that it is the second class above; 
and so on. Likewise the 50- class has a d entry of — 1, showmg 
that it 18 the first class below that in which the assumed mean 
lies; the next lower, or 45- class, has —2, showing that it is 
the second class below; and so on down.* 

* It should be noted that the numbers appearing in the d column are 
in no way influenced by the frequencies. If the frequency is zero for a 
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The fd entries are obtained, aa in Table VI, by mnltipljring 
each/ by its corresponding d. Thus for the 75- class 3 X 4 = 12, 
for the 70- class 5 X 3 = 15, and so on The products are 
summed as before, giving +45 and —44, which yield an alge- 
braic sum of +1. When divided by 40, the number of cases, 
this equals + 025, called the correction and abbreviated by c. 
Since, however, the computation leading to this has been made 
in terms of class intervals and each interval is five umts on 
the scale of measurement used, this value of c must be multi- 
plied by 5, the width of the interval, abbreviated i, to obtain ci, 
which IS the amount to be added algebraically to the assumed 
mean to give the true mean Domg this, + 125 is obtamed, 
the same as was found by the last method, and therefore the 
same mean, 57 625, results when it is added to the assumed 
mean As is easily seen from Table VII, the formula for this 
method is 


M = Ass. M + Cl, or, since c = 



M = Ass. M + 



It has already been stated that no error Js introduced mto 
the computation of the mean if the guess as to the class m 
which it lies IS incorrect This suggests that if one desires to 
check the accuracy of a mean, a convenient way of doing so is 
to take an assumed mean in another class and repeat the work 
to see if the same result is obtained. Table VIII presents such 
a computation for the data just given with the assumed mean 
taken in the 60- class, or, in other words, at 62.5. This gives, 
as is shown, a value of S/d of —39 Dividing by 40, c = —.975 
and multiplying by 5, a = —4.875. Adding this algebraically 
to the assumed mean, 62.5, results in a mean of 57.625, as al- 
ready found. 

A situation that occasionally occurs in the computation of 
the mean is that all the classes are not of equal width. Usually 

particular class, that does not affect the distance of that class from the 
one in which the assumed mean hes. For example, if m the illi^Uation 
above there were no cases m the 40- class, this would still have a d entry 
of -3 In other words, no classes withm the distribution may be skipped 
m assigning the d values. 
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TABLE Vni 

Shobt Mbtbop or Computino Mban or 
Mbabttrks in FfixomiiNCT Distbibotion * 


/ 

d 

fd 

75- 3 

+3 

+ 9 

70- 5 

-4-2 

+ 10 

65- 6 

+1 

+ 6 

60- 6 

0 

+ 25 

55- 6 

-1 

- 6 

50- 4 

-2 

- 8 

45- 2 

-3 

- 6 

40- 2 

-4 

- 8 

35- 3 

-5 

-15 

30- 1 

-6 

- 6 

25- 1 

-7 

- 7 

20- 1 

-8 

- 8 

JV - 40 


—64 


40|-39 = S/d 
c - - 975 
t - 5 


r» - -4 875 
Ass M - 62.5 
M - 57 625 

r 

* Thu differe from XiBble VII to that the assumed mean ir taken m a different olaae. 


in such a case there is only one that differs from the others. 
For example, if a series of percentile marks ranging from zero 
up to 100, inclusive, compose a tabulation, the lowest class 
often begms with zero and the next to the highest ends with 
99, the highest including only marks of 100. In such a case 
the group containing the marks of 100 does not have a width 
equal to that of the other cla&ses, for which probably either 
five or ten would be chosen, and thus its deviation from the 
assumed mean or entry in the d column is not one interval 
greater than that of the class immediately below it. Instead 
of one mterval, the difference is .5 interval plus one-half the 
width of the class having a different width from the others. 
Thus, if classes of 5 are used, the next to the highest class is 
the 95- class, or better (since percentile marks are being dealt 
with), the 94.5- class. This class, of course, extends up to 
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99.5, 80 that marks of 100 ii^ude:‘tiio8e from 99.5 up to 100. 
The 100- class, therefore, covers a range of .5 per cent or unit. 
Half of this, which is .25 unit, divided by 5, the class interval, 
gives .05 interval. Adding this to .5 interval gives .55 interval, 
the distance of the 100- class above the 94.5- class. Another 
way of amving at the same result is to subtract 97, the mid- 
pomt of the 94.5- class, from 99.75, that of the 100- class. The 
result 18 2.75, which, when divided by 5, gives a difference of 
.55 mterval, the same as was found by the other method. 

Determining class mid-points. An important point that 
arises m the computation of means and likewise of some other 
statistical measures is the determmation of the mid-points of 
classes. The method employed in the examples previously 
given IS the most common or conventional method. It is to 
take .the _mid-point halfway between the lower limit of the 
class as given in the tabulation and the lower limit of the next w 
class. This procedure is based upon the assumption that a 
score or measure of a given magnitude means from that up to 
the next larger magnitude. Thus, m the senes of scores used 
in the computation of the mean, a score of 50, for example, 
means from 50 up to but not mcluding 51, a score of 51 means 
from 51 up to but not includmg 52, and so on. This assumption 
agrees with the scormg system used on most standardized and 
other objective tests, since, if a pupil responds to fifty items 
on such a test correctly, and almost but not quite correctly to 
another, his score is 50 and not 51. Therefore a score of any 
given size, such as 50, denotes performance equal at least to 
that much and perhaps almost equal to the next possible score. 
Hence the average score of all pupils receivmg 50 is taken as 

50.5, of all those receiving 51 as 51.5, and so on. Consequently 
the mid-point of the 50- class, when its width is 5, is 52.5, or 
halfway from 50 up to the lower limit of the next class, 55. 

There are some situations, however, in which mid-points 
should be taken otherwise. In using the ordinary percentile 
marking system in connection with traditional examinations, 
teachers usually assign per cent marks on the plan that if 
they think the pupil deserves more nearly a given per cent 
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than the per cent immediately below or above it, he is given 
that mark. A mark of 82 per cent, for example, denotes that a 
pupil’s work is rated as nearer 82 per cent than 81 or 83 per 
cent, or as above 81.5 per cent and below 82.5 per cent. The 
same is true in the use of scale.s such as those in handwriting, 
drawing, and composition for rating sfiecimens of pupils’ work. 
Thus, if a specimen of handwriting is compared with the Ayres 
Handwriting Scale, which is composed of specimens at intervals 
of ten from 20 to 90, mclusive, and the specimen is judged more 
similar to the scale sample at 50 than to the one at 40 or 60, 
it IS given a rating of 50, which thus signifies that it is thought 
to faU somewhere between 45 and 55 

In cases such as those just ciliKi a given score or measure is 
a mid-point rather than a lower limit. Consequently the mid- 
point of a class in a tabulation composed of measures of this 
sort is one-half of a scale unit lower than the mid-pomt accord- 
ing to the other and more usual meaning of scores If, for 
example, measures used in the computation of the mean are 
percentile marks given in the ordinary fashion, the raid-point 
of the 50- class is 52, not 52 5, that of the 55- cla!3s is 57, not 
57.5, and so on. In drawing up a tabulation and in labeling 
classes involving cases such as this it is best to use what are 
really the true lower limits. For percentile marks, ratings 
according to such scales as were mentioned, and other similar 
data grouped by fives, for example, the lower limits of the 
classes should be 49.5, 54 5, and so on, rather than 50, 55, and 
BO forth. If the limits are expn'ssed thus, the true mid-points 
may be found in the conventional way, since they he halfway 
between the lower limits of each class and those of the next 
higher cl^. Thus halfway from 49.5 to 54,5 gives 52 as the 
mid-point of this class, just as was stated above. 

Sometimes the tw'o types of distributions or data just re- 
ferred to are distmgmahed from each other by the terms per- 
formance scale and product scale. A performance scale is one 
for measuring such pupil performances as the spelling of words, 
the solution of problems, the giving of facts of any sort, in ail 
(rf which cases a score of a given tunount means that the pupil’s 
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performance is fully that mudi but not so great as the next 
possible score. A product scale includes such instruments as 
were referred to above, that is, handwntmg, composition, and 
drawing and other similar scales, on which a given score de« 
notes quality nearer to that score than to either the one below 
it or the one above it. 

The reader is probably at this point wondering how he is to 
know when to use the one method and when the other. The 
writer will not attempt to give an authontative and compre- 
hensive answer to this question. Statisticians do not agree 
either as to which of the two methods is in general the better 
or which to use in dealing with certain types of data. The 
following general rule, however, is recommended as being con- 
sistent with the most common practice and as being apphe^le 
to most cases that anse. Unless it is specifically stated m con- 
nection with the data m question, or is evident from their 
nature, that they are of the second t3rpe, the first procedure 
discussed above should be followed. In other words, a given 
measure should generally be taken as meanmg from that up 
to the next higher measure. 

The median. The median, abbreviated M 4 , Med, or Mdn, 
is generally defined as that pomt on the scale on each side of 
which one-half of the measures fall. This definition of median 
is often 081x1 in connection with any senes of measures arranged 
in order whether it is a simple senes or a frequency distnbu- 
tion. It is better, however, to limit the term median to the 
mid-point of the latter and to use mid-score for that of the 
former. It should bt* noted that the median is a pomt on the 
acale and not a score or measure, thereby preventii^ certain 
errors in conception and calculation that have ansen. The 
median is obtained by counting m from either end of the dis- 
tribution until exactly one-half of the cases have been taken 
and determining the point that has been reached to accom- 
plidi this. Counting m from the two ends yields identical 
results and may be used to check the correctness of the answer. 

The computation of the median will be illustrated by several 
examples. The first of these, which presents a tabulation of the 
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salaries of 100 hi^-school teachers, is given in Table IX. 8in«5e 
the number of cases is 100 the median, accordmg to definition is 
that point on the scale on each side of which fifty of the cases fall; 

therefore one must count in fifty measures from 
TABLE IX one end or the other. Starting from the lower 

Computation of end of the distnbution, as is more usual, and 

THE Median adding the frequencies, one gets 7 + 14 = 21, 

j. then 21 + 22 = 43 If the next frequency, 16, 

— is added, the result is 59, which is too great, 

2 IS more than halfway through the dis- 

2000- 4 tribution. Instead of adding it one must find 

1900- 6 the point in the 1509- class below which 7 of 

^ cases he, since 7 more cases must be 

#1000- la added to 43 to make 50 Inasmuch as the cases 

-1500- 16 in a given interval are assumed to be distrib- 

13^ 14 uniformly throughout that interval, one 

1200 - 7 takes of the width of the 1500- interval to 

^ - IW obtain that portion of it which includes the 

^ first or lowest 7 cases. As 

Md - 1600 " — 100 - 1.543 75 width IS 100, and A of 

100 are 43.75, this amount 
~ “ 18 added to the lower limit 

of that class, which is 1500, and the result, 1543.75, is the point 
below which and likewise above which, fifty, or one-half, of the 
total number of cases he. It is, therefore, the median. 

As was suggested, the same result may be obtained by count- 
ing down from the upper end of the distribution. Doing this 
one adds the frequencies as before, thus 6 -f 2 = 8, 8 -f 4 = 12, 
12 + 5 = 17, 17 4- 6 = 23, 23 + 8 = 31, 31 -f- 10 = 41. Since 
9 more cases are needed to make 50, ^ of the distance down 
into the 1500- class must be taken to reach the pomt above 
which 60 cases lie. Nine-sixteenths of 100 are 56.25, and sub- 
tracting this from the upper limit ♦ of the 1500- class, the same 
result as before, 1543.76, is obtained. 

The process just described may perhaps be made clearer by* 

*The real upper limit of the 1500- class is 1599.99+, but it is eonven- 
tfamal to take instead the lower bout of the next class, in this case 1600. 


Md - 1600 4- 




1.543 75 
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a graphic illustratioD. Figure 28 repreeents the ISOO- class of 
the given distribution. As is indicated on it, there are forty- 
three cases below 1500, the lower limit of that class, and forty- 
one oases at or above 1600. The sixteen cases within the given 
class are considered uniformly distributed throughout it accord- 
ing to the assumption generally made for frequency distribu- 
tions. That 18 , the distance from 1500 to 1600 is divided into 
sixteen equal spaces and one case is located at the center of 
each space. Therefore to find the pomt on each side of which 
lie fifty cases one counts up from the lower end, adding cases 
to the forty-three that u^i . . 

are below 1500 until 43 | 4 l 

enough have been 

added to make a total 1543.7s I600 

, „ , FIG 28 GRAPHIC REPRESENTATION 

of fifty. Since the OF computation of the 

number required to median 

do this is sev^en the The meduiii w at 1543 75, which ia of the 

, . , L j • I distance from 1500 to 1600. 

median is the divid- 
ing point between the space at the center of which is the sev- 
enth case from the lower end and the next highN|r .space, that 
is, the one at the center of which the eighth case from the lower 
end is located. 


The steps necessary to find the median may be stated as 
follows; Divide the total number of cases by two. Starting «t 
either end of the distribution, add the frequencies in order until 
their sum is as great as possible without exceeding one-half the 
total number of cases. Subtract the sum thus obtained from 
one-half the total number and use the result as the numerator 
of a fraction. The denominator is the number of cases m the 
median class, that is, the class immediately above or below, 
according to the direction in which the frequencies have been 
added,' the last class whose frequency was included to get the 
sum referred to above. Multiply this fraction by the width of 
the class. If frequencies have been added upticom the lower 
end of the scale the resultmg product should be added to the 


' If the frequencies have been added up, the next higher elaan is the 
median class; if they have been added down, the next lower one. 
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lower limit of the median class. If they have been added from 
the upper end down the product should be subtracted from the 
upper limit of that class. The result, m either case, is the median. 

The computation just described may be expressed in formula 
form thus: 


Md = f + 



or = u 



S 

—i. 


In these formulse N is the total frequency;/ the frequency in a 
single class, the median one in this case, 5 is the partial sum, 
that is, the greatest sum of frequencies that can be obtained 
without exceeding one-half oi N, f ® stands for the lower limit 
and u for the upper, of the median class; and the last term, i, 
stands for the width of the interv'al. Applying the formula to 
the example previously used, wc have: 


Md = 1500 = 


f-43 
16 


100 = 1543.75, or 


Md =» 1600 - 



16 


100 = 1543.75. 


The next example illustrates the fact that the total number 
of cases may be odd instead of even without affecting the com- 

N 

putation of the median. In such cases ^ ends in J instead of 

being a whole number. For the example in Table X the for- 
mula give: 


Md = 550 + 


4J. 

'2 


18 


-50 = 592-, or 


Md = 600 




50 = 592-. 


* Sometimes instead of simply I and u, the abbreviations U and tii are 
employed. 
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There are several special cases some- 
times encountered in the calculation of 
medians. Only one of these, however, 
occurs frequently. It is that in which a 
partial sum exactly equal to one-half 
the number of cases is obtamed. Such 
a case may be handled by the formulie 
with correct results. This is illustrated 
in Table XI. Applymg the usual for- 
mula, we have. 

f-20 

Md = m + ^ 5 = 60. 

D 

Counting down from the top: 


TABLE X 
Computation of 
THE Median When 
Number of Cases 
Is Odd 


/ 


800- 2 
750- 2 
700- 6 
650- 5 
600- 5 
550- 3 
500- 8> 
450- 6 
400- 3 
350-J 
AT - 41 


Md = 60 - 


f-20 

6 


41 

Md - 550 -f- — 50 - 592- 


TABLE XI 

Computation of 
THE Median 

N 

When 5 = ^ 


It is not necessary, however, to go through 
the process of applying the formula m such 
cases since the numerators of the fractions m 
both formulae become zero and thus the for- 


/ 


75- 3 
70- 5 

65- 6 
60- 6 

66 - 6 
60- 4 
45- 2 
40- 2 
36- 3 
30- 1 
25- 1 
20-J 

JV - 40 


mulae become simply Md = I or u. In other 

N 

words, if <S comes out just equal to -g , the me- 
dian IS the lower limit of the next class if one 
IS adding frequencies upward, and the upper 
limit of the next if one is adding downward. 
In this case the former results in locating the 
median at the lower limit of the 60- cla% and 
the latter at the upper limit of the 55- class. 
The median, therefore, is 60. 

The other special cawes are «11 rather rare, 
but they do sometimes occur and therefore will 


Md- 90 + 



60 


be discussed. Table XII presents 
the same feature as the last, that S 

N 

happens to come out equal to > 
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but is f\uther complicated 
TABLE XII 

Computation of thb Median 
N 

When S = — and Adjacent 

A 

Clabb Frequenct Is Zero 

- 


by the fact that the class imme- 
diately above the last class for 
which the frequency is included 
in S, or below it if one has added 
downward, is a class with a fre- 
quency of zero. A strict applica- 
tion of the formula gives: 


30- 4 
27- 6 
24- 8 
21 - 0 
18- 4 
15- 6 
12-_7 
N - 34 

Md - ~ 22 5 

£ 


Afd = 21 + 


Md = 2i - 


^-17 
2 

0 


3 = 21, 


?^-17 
2 


0 


3 = 24.’ 


and 


TABLE XIII 

Computation of the Median 
N 

When S =• — and Adjacent 

Class P^ooencieb Abe 
Zero 


Thus the values obtained from the two forms of the formula are 
not the saqie. Since one-half of the cases are below 21 and the 
other half abav,e 24, any point be- 
tween those values has one-half of 
the measures on each side of it 
The mid-point between these two 
values, which is the average of the 
results from the two forms of the 
formula, is taken as the median 
In this case it is 22 5. A rule may 
be stated thus: when iS is equal 
N 

to and there is a zero frequency 

in the next class, one should add 
one-half of the width of the inter- 
val to the lower limit of the me- 
dian class, which is the one con- 
taining no cases, or subtract the 
same amount from its upper limit. 

*The expreasion to which the fractional ptarte of the formula reduce, 
f , ia, in general, of indeterminate value. In this case it can be shown that 
it may be taken as equal to zero. 


/ 

50- 

4 

45- 

8 

40- 

6 

35- 

3 

30- 

0 

25- 

0 

20- 

7 

1.5- 

14 

N - 

42 

Md- 25 + 
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In either case the result is the mid-point of the class with the 
aero frequency. 

The next example, Table XIII, illustrates the same difficulty 
except that there are two classes with zero frequencies instead of 
only one. The procedure is exactly the same. From the for- 
mulae we obtain, respectively, 25 and 35, and averaging them, 30. 
Applying the last suggestion in the precedmg paragraph with a 
slight modification, the same result may be obtained by add- 
ing 5 to 25 or subtractmg 5 from 35. The modification con- 
sists in the fact that instead of adding or subtracting, as the case 
may bo, one-half of the width of the interval, one should add or 
subtract one-half of the total distance on the scale covered by 
the classes with zero frequencies. Since there are two classes 
with zero frequencies, the distance they cover is ten, and one- 
half of this, five. If there were three classes with a class m- 
terval of five the amount to be added or subtracted would 


be 7.5, if four, 10, and so on. 

Table XIV illustrates the com- 
putation of the median when the 
width of the interval is not uni- 
form throughout the distnbution. 
The only special pomt to be carried 
in mmd is that i, as used m the 
formula, is the width of the inter- 
val immediately above or below the 
last one whose frequency is required 
to secure S, or, in other words, of 
the interval wherein the median 
lies. In the example given, the 
class contaming the median is the 
30- class and so i is 10. Therefore, 

T-^ 

Afd = 30 + -10 = 31.5 


TABLE XTV 

CoMPUTATrOW thb Msduk 
When Class brrxRVAL Is 
Not UNiroBM 


/ 


100 - 2 
75- 3 
50- 6 
40- 9 
30- 10 
20- 7 
15- 6 
10- 5 
6 

0- _4 
N » 67 


o '" 

Md ~ 20+ — 10 - 31.6 


Occasionally a distribution resembhng that in Table XV is 
found in which more than one-half of the cases fall in the lowest 
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or highest class. The procedure is strictly by formula, thus, 


TABLE XV 

Computation of the Median 
When Frequency of Ex- 

TREMB Class Exceeds 


Md = 0 + 


22 


1 = .91, or 


40 


- 18 


1 - 


Af«f - 0 + 


6- 
5- 
4- 
3- 
2 - 
1 - 
0 - ^ 
N = 40 

2 


22 


1 = .91. 


- 0 


22 


If one begins to add the frequencies 
from the end at which the class 
containing the large frwjuency is 
found, no friKjuencies at all can be 
taken and still leave 8 smaller than 

2 Therefore, as is shown by the 

-1 = .91 formula, the median lies in the class 
having the large frequency. 

The foregoing discussion of the median has assumed that 
continuous series are being dealt with. As has betm stated else- 
where, the general practice in handling discontinuous series is 
to handle them as if they were continuous In some cases, 
however, a different method may be preferable. Table XVI, 
which gives a distnbution of classes of 
pupils of different sizes, illustrates this. 

The application of the formula yields a Computation of the 
median of 42.67. Evidently, however. Median of Discon- 
there cannot be a class m which there are 
42.67 pupils. All of the classes of pupils 
in the 42- interval must have e.xactly 42 
pupils in them, and therefore if the me- 
dian falls anywhere in this interval it 
should logically be taken as 42. Practice 
is not uniform in so domg, but tends to 
sanction this procedure rather than the 
use of a fractional median. The reason 
is that the median of such a senes is essen- 
tiaOy a mid-score rather than a median. 


TABLE XVI 


TINUOC8 Series 


4&- 2 
44- 3 
43- 4 
42- 6 
41- 5 
40 -^ 
N - 22 

^.11 


2 

Md 


42 
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since the measures are not grouped in such a way as to lose 
their original identity. 

If, however, instead of all of the measures m one class being 
of exactly the same size, each class includes those of more than 
one size, th(i data art* usually treated as though they were con- 
tinuous That IS, if all classt's of size 40 and 41 are grouped to- 
gether in a 40“ inten al, thost' of 42 and 43 in a 42- interval, 
and those of 44 and 45 in a 44- interval, the usual practice is to 
adhere to the fonnula and secure a fractional median Thus, 
usmg a class interval of 2, the given siTies becomes one with 
seven cases in the 40- interval, ten casi's in the 42- mterval, 
and 6ve cases in the 44- interval. The median is then 


42 + = 42.8. 

Since standard test norms are frequently expressed in terms 
of medians, it should be noted that this practice introduces a 
discrepancy when individual scores are compared with norms, 
similar to that between the mean of an ungrouped and of a 
grouped series The procedure for computing the median is 
based upion the same assumption as to the meaning of scores 
as was stated to be the conventional one m connection with 
the mean. This is that an obtained score of a given amount 
may represent a true score of any value from that up to the 
next higher possible score When the scores of mdividuals are 
given, however, this practice is not followed For example, if a 
pupil spells eight(H;n, but not nineteen, words correctly on a 
spelhng test, his score is reported as 18, no matter how nearly 
he spells one or more additional words correctly. If he were 
given the score that repn'stmts the mid-score of all pupils who 
spell at least eightetm words correctly but not mneteen, his 
score would be 18.5, and would correspond to the median as to 
its underl 3 dng assumptions. Since, however, this is not done, 
an individual score is one-half of a score umt less than a group 
median that really denotes the same amount of achievement 
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or level of performance. Otis * has urged that in computing 
medians the lower and upper limits be taken one-half scale unit 
lower than has been done in the examples given above, and 
thus group medians made entirely comparable in meaning with 
individual scores. His suggestion, however, has not been gen- 
erally accepted and followed. 

The mid-score. The mid-score or mid-measure is to a simple 
or ungrouped series what the median is to a grouped series or 
frequency distribution. In fact many wnters do not differen- 
tiate it from the median, but use the latter as a general term 
to include both. As the method of finding it is somewhat dif- 
ferent from that of finding the median, and as it applies to a 
different sort of series, it seems helpful to preserve the distinc- 
tion. The mid-score may be defined as the middle measure of 
a series of measures or scores arranged m order of size. If the 
number of cases is odd there is no doubt as to the middle one. 
If the number is even there is no one score that is really the 
mid-score, so the average of the two mid-most scores is taken. 

To illustrAte securing the mid-score the following series of 
scores may be employed- 28, 36, 43, 47, 49, 51, 63, 56, 56, 59, 
62, 62, 64, 65, 68, 69, 70, 72, 74, 77, In this mstance, since the 
number of cases, twenty, is evim, the average of the two mid- 
most scores is the mid-score. These are the tenth and eleventh 
from the first. Since they are 59 and 62, respectively, 60.5, 
their mean, is the mid-score of the series. If, however, there 
were only nineteen scores in the senes, the last one, 
77, being omitted, the mid-score would be the tenth, 
69, since there would be nine on each side of it. 

In case it is desired to find the mid-score of a dis- 
tribution that has been tabulated mto classes, a slightly 
different method may be used. If the .senes just given is 
tabulated by tens, the resulting distnbution is as shown 
at the right. From such a tabulation the mid-score can 
be determined byarrangmg in exact order only the scores in 
the class within which it is evident it falls. In this case, since 

• Arthur 8. Otia, StaltsUcal Method tn Edxuuiiional MeaawemerU (Yonkers- 
(m-Hudaon, Worid Book Co , 1925), pp. 48-61. 


/ 

70- 4 
60- 6 
60- 5 
40- 3 
30- 1 
20 - 2 _ 
A ^=20 
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there are ten cases up to and including the 50- class, and ten 
above that, it is at once evident that the mid-score, accord- 
ing to rule, is the mean of the highest case in the 50- class and 
of the lowest one in the 60- class. Smce these are, of course, 
59 and 62, the mid-score is found to be 60.5, as previously. 

In case the scores are already arranged m exact order there 
is no economy m using this method. In case they are few in 
number, not more than twenty-five or thirty, the saving is very 
little. When the number of cases becomes as great as forty or 
fifty its use saves some tune. It is likely, however, that if there 
are as many cases as this, and they are grouped in classes, the 
median rather than the mid-score will be desired. 

It is possible to use this method even if the measures have 
not been grouped in classes. To do this one must estimate 
about where the mid-score will fall. If, for example, one esti- 
mated that it would fall somewhere above 50, the number of 
scores below 50 should be ascertained and the 
counting process performed just as indicated T^LE XVII 


above. 1 u!.i78tration 

In dealing with the papers from an ordinary or Mode 


class the easiest method of finding the mid-score / 


IS usually to arrange the papers in order accord- ^ 

ing to the size of scores and then merely count 10- 1 
through them to determine the middle one if 0-2 

the number is odd, or the two mid-most ones if 7-3 

it is even. This obviates the necessity of record- &- 5 

ing the scores m order of size. ^ 10 

The mode. The mode of a frequency dis- 3 _ g 

tribution is that point on the scale at which 2 - 5 

there are more measures than at any other point. ® 

Thus it may be said to represent the typical value ^ — 

or case. For example, in the distribution in Mo - 5- 
Table XVII the mode, abbreviated Mo or Z, is 


5-, as the frequency corresponding to a scale value of 6- is 
greater than any other frequency. Such a mode is called a 
crude, empirical, or inspectional mode, because it is obtained 
by mere casual inspection of the distribution. If the scale were 
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infinitely divided and the measures recorded exactly, that point 
at which the frequency was the greatest would be the true or 
theoretical mode. If this were done in the example given it is 
probable, but not certain, that the true mode would fall some- 
where between five and six If a smooth curve is drawn to rep- 
resent the distribution, the point on the base-line scale that is 
directly below the highest point of the curve is the true mode. 
Since its calculation involves rather difficult mathematics and 
also it IS rarely used in handbng educational data, it is not given 
further consideration here. 

Although the true mode is rarely employed in educational 
work an approximation to it is not infrt»quently used In case 
the distribution is normal or only moderately skew, the formula 
Mo = M — 3(M — Md) * yields a value that approximates the 
true value. This formula shows that if the mean and the median 
are the same, as is always the cas<> in a symmetrical distribution, 
the mode likewise has the saini* value If, however, the mean 
and the median are not the same, the mode lies on the same side 
of the mean as does the median, but is three times as far away. 
For greater convenience this fonnula may be changed into the 
form Mo — 3Md — 2Af. Applying it to the distnbution given 
in Table XVII, for which M = 4.85 and Md = 5 15, we have 
Mo = 3 5 15 - 2 4.85 = 5 75 

Although not so commonly employed as the one just given, 
there is another formula that yields an approximation to the 
true mode. It is 


Mo = I 


+ 


u 

fa +/» 


In this formula I stands for the lower limit of the modal class; 
fa 18 the frequency of the class just above the modal class; /t 


' More exactly the fonnula given al>ove is as follows- 


Mo 


M - 


M- Md 


.3309 - 


0846(At-Md)« 
- 9(M-Md)« 


which for moet distnbutiona is approximately e(]ual to 
Mo - M - 3.03(M - Md). 
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that of the one just below it ; and t, the width of the class interval. 
Applying this formula to the distribution given above, 

“ 5 + 5^2 - 

This, it will be seen, is relatively close to the mode obtained by 
the more usual method already given, 5 75. If a distnbution is 




FIG. 29 GRAPHIC REPRESENTATION OF THE MEAN, MEDIAN, 

AND MODE 

approximately symmetrical it will usually follow that the two 
formulse give results very nearly the same, but if it is not they 
may differ considerably. 

In case measures have been grouped mto a frequency dis- 
tribution it is impossible from inspection to ascertain even the 
crude mode exactly. Instead, all that is possible is to state that 
the mode falls within a certam class. Thus for the distribution 
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given above in connection with the mid-ecore the mode would 
be said to be in the 60- class, but not at 60 or any other particuUur 
point. 

The relationship existing between the mean, median, and 
mode may be better understood if it is illustrated graphically. 
Unless a distribution is symmetrical, it is only by chance that 
any two of them coincide. In the two surfaces shown in Figure 29 
the positions of all three are shown (the formula Mo = ZMd 
— 2M being used for the mode) One can see that, as has been 
stated, the modes are on the aame sides of the means as the 
medians and three times as far away On the upper surface, 
which IS only slightly skew, the three ai'eriiges are much closer 
together than on the lower one, which is more skew. 

Sometimes a mode is defined as any scale value at which the 
frequency is greater than at the values immediately above and 
below it. In this sense a distribution may have a number of 
modes. The one given in Table X\TI has three, one at 3-, one 
at 5-, and one at 8- It may, therefore, be spoken of as having a 
mode at 6-, or as having th<‘ thrcM? modes just mentioned. Many 

TABLE XVIII 

IliVSTRATION OF EfFECT OF DIFFERENT 
Classification^ vpon Apparent 
Valve of Mode 


f 

/ 

/ 

lO- 2 

!)- 1 

8- 8 

8- 6 

0- 12 

4- 20 

6- 8 

18 

0- 21 

4- 12 

2- 11 

0- 10 

A" = 49 
Mo = 4- 

0- 15 

N = 49 

,1/0 = 3- 

A - 49 

Mo = 0- 


distributions have only one mode, even though the second 
definition be used. If the one referred to above had a frequency 
of SIX, seven, eight or nine at 4- and of four or five at 7 it would 
have only one mode. Such a distnbution is spoken of as unt- 
modaJ, whereas one with more than one mode is called tntiMir 
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modal. In a multi-modal distribution the point at which there 
is the greatest frequency is often called the major mode and the 
other modal pomts minor modes. The term bt-modal is often 
applied to distribution with two modes. 

It should be noted that a different classification of the meas- 
ures frequently changes the class in which the crude mode falls, 
and therefore changes its apparent value. To illustrate this 
the measures in the distribution above have been regrouped in 
classf's of two, three, and four umts. The crude mode is then in 
the 4- class, the 3- class, and the 0- class, respectively. There 
is overlapping, and hence no necessary mconsistency, between 
the first two and also between the last two, but the first and the 
last are not consistcmt, since according to the first the crude 
mode IS within the limits 4- 5.99+, and according to the last, 
withm 0- 3 99+, both of which cannot be true. 

The geometric mean. The geometric mean, although fairly 
widely used in connection with index numbers in business, indus- 
try, and elsewhere, has been rarely employed in educational 
work The most common occasion for its use therem is m the 
computation of rates of increase, such as the population of a 
city or state, the enrollment in a school system, and so on. It is 
abbreviated by G, GM, or and is obtained by the formula: 
G = vA'i A'l Xj A'v In other words, the geometnc mean 
18 the ATh root of the product of N measures Since it is rather 
difficult to extract most roots by other methods, logarithms 
are almost always employed in its computation. When log- 
anthms are used the following formula is employed: 

. logA'i + log.Y» + logA's + . . . + logX.v 
lOgCr ^ 


which may be written more briefly. 


logG = 


SQogX) 

N 


” The reader who is not familiar with logarithms and their use is re- 
ferred to the following reference or to practically any standard text in 
college algebra or trigonometry: 

Karl J. Holzinger, Suaisltcol MfJhenls for StvderUs in Education (Boston, 
Ginn & Co , 1928), Ch. iv, “Logarithms.” 
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To illustrate the use and computation of the geometric mean 
let us assume that the population of a certain city was 20,000 
in 1920 and 28,000 in 1930, and that the average annual rate of 
increase is desired. One might carelessly suppose that, since the 
total increase dunng ten years was 40 per cent, the increase 
dunng each year was 4 per cent. This would be true if the 1920 
population were taken as the bast' throughout the whole ten- 
year period. This is not proper, however, since the rate of 
mcrease for each year should be based upon the population of 
the preceding year, not upon that of 1920 or any other single 
year. The first step in the solution is to find what per cent the 
1930 population was of that of 1920. Dn iding 28,000 by 20,000 
gives 140 per cent. This quantity is equal to the whole product 
under the radical, or, if logarithms are used, its logarithm equals 
the entire numerator of the fraction '* The tenth root of 1 40 
is next found. The logarithm of 1 40 is 146128, which, when 
divided by 10, gives .014613 The antilogarithm of this is 
1.0342 or 103 42 per cent, the tenth root of 1 40. This is the 
per cent that each year’s population was of that of the previous 
year, assummg a uniform rate* of increase Therefore the average 
increase was this minus 100 ptu cent, or 3 42 per cent 
In many cases there are further details at hand than were 
given above. One might know, for example, that the iiopulation 
of the city was 22,000 in 1923 and 25,000 in 1926 Such addi- 
tional information is useless, unless it is desired to ascertain the 
rates of increase for each of the shorter periods instead of one 
uniform average rate for the whole time. 

The geometric mean of a simple senes of numbers has no con- 
nection with a rate of increase nor any meaning as such a rate. 
The geometric mean of 2, 3, 4, 6, and 8, for example, is the fifth 
root of their product, 1152, which is approximately 4.095 Such 
a geometric mean rarely has any useful significance m educational 
work, although it does have a definite mathematical meai^g 

In this, as in most problems involving the geometric mean, thb entire 
quantity is given, rather than each of the mea.sureu that compose it, 

” The antiloganthm is the number tliat corresixinds to the given log 
arithm For example, the loganthm of 3 is .477121, hence the antilor 
arithm of 477121 is 3. * 
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There are several points about the geometric mean that 
should be mentioned. One is that it is always less than the 
arithmetic mean of the same data. A second is that there are 
certain cases in which it loses its significance If any single 
measure is zero the product of ail is zero, and therefore the 
geometric mean is zero and mori' or less meaningless Also, the 
presence of a single negative number or of any odd number of 
negative numlx-rs in a senes con-sisting of an even number of 
measures causi's the geometne mean to become an imaginary 
quantity, the even root of a negative number Kven if the 
number of cas(‘s is odd, .so that an odd rcxit of a negative number 
is to be e.xtractixl, the result, though obtainable, is not really 
significant For example, the actual giHimetnc mean of —2, 4, 
8, IG, and .32 is eciual to \/~32768 or —8 For most purposes, 
this quantity can hardly lx* considered to surnmanze or represent 
the 8(‘ri(xt gi\<‘n above The same is true of an even root of the 
product of a stTies of measures that includt^s an even number of 
negatn e measvires For example, the g(*om('tnc mean of —8, 
—3, 6, and 9 i.s G, obtaimnl, of courst', by taking the fourth root 
of their pnxiuct, thus v — 30 — H9 = v'12tK) = 6 , but 6 is 
rarely if ever an adisjuate expression of the central tendency of 
the four numlx rs just gueii 

The harmomc mean. The harmonic mean is the reciprocal 
of the irw'an of tlu' recipioeals of the rneiusurre It is not used to 
any gix'at extent m actual statistical work If one is dealmg with 
time rap's or certain other sorts of data, however, it is some- 
times desirable to employ this measure. With such data either 
the arithmetic or the hanuonic mean may bt* list'd, but the two 
are not comparable with each other. They imply different units 
of computation, the unit of work, and the unit of time. To 
secure an average time rate one must, if working with the unit 
of work, us(' either the harmonic mean of the rates or the arith- 
meti4|||ean of the absolute limes, and, if working with the unit 
of tiniill the arithmetic mean of the rates or the liarmonic mean 
of theSisoiute times. 

The problem solved in Table XIX illustrates the computation 
and interpretation of the two means with th§ different units. 
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TABLE XIX 


Computation of the Harmonic Mean 


Number of 
Problems per 
Hour 

Rectjtrocal of 
Number of 
Problems per 
Hour 

Number of 
Minutes per 
Problem 

Reciprocal of 
Number of 
Minutes per 
Problem, 

15 

.0667 

4 

2500 

12 

.0833 

5 

2000 

10 

1000 

6 

.1667 

6 

.1667 

10 

.1000 

4 

2500 

15 

.0667 

3 

3333 

20 

.0500 

6|50 

6|1 0000 

6' 60 

6| 8334 

8.33 

1667 

10 

1389 

{Problems per 

(Hours j>er 

( Sfinutea per 

{Problems per 

Hour) 

Problem) 

problem) 

Minute) 

60 -e 8.33 = 7.2 

1 - 1667 = 6 

60 - 10 = 6 

1 - 1389 - 7.2 

minutes per 

problems jier 

prol)lcras fier 

minutes fier prob- 

problem accord- 

hour 60 — 6 = 

hour according 

lem 00 - 7 2 - 

mg to the anth- 

10 minutes per 

to the anth- 

8 33 problems per 

metic mean of 

problem accord- 

nietic mean of 

hour according 

the rates. 

ing to the har- ' 
monic mean of j 
the rates ! 

the absolute 

times 

to the harmonic 
mean of the ab- 
solute times 


The average of the first column, 8 33 problems per hour, is the 
average number of problems work(>d in an hour if all individuals 
work an equal amount of tune Therefore 60 -4- 8 33 = 7.2 
minutes per problem, the aicrage time required to work a 
problem under the same conditu n The average of ten mmutes 
per problem obtained from the third column is the average 
number of minutes per problem if each individual works the 
same number of problems rather than the same amount of time. 
The same is true, of course, of the average of six problems per 
hour based upon the ten minutes p« r problem From the second 
column, which contains the reciprocals of the numbers given 
in the first, these same results of six problems per hour or ten 
minutes per problem are secured. Likewise, from the fourth 
column, which contains the reciprocals of the entnes m the 
third, the same averages are secured as were found directly 
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from the first. Thus it is seen that the harmonic mean baaed on 
rate is the same as the arithmetic mean based on amount and 
vice rerao.** If the data are presented m the form given in 
column 1 the harmomc mean of the rates may be found by using 
the absolute reciprocals, as m column 2, or by using those given 
in column 3. 

Perhaps the reason for the difference between the arithmetic 
and harmonic means may be made clearer by the following 
explanation If the six pupils for whom data have just been 
given work the same amount of time, the ablest one, since he 
solves the most problems in that time, contnbutes more prob- 
lems or units of work to the total and, therefore, to the average, 
than does the next ablest, and so on On the other hand, if the 
SIX pupils work th(‘ same numlx'r of problems, the ablest one 
contnbuU'S no more problems or units of work than does any 
of the others, but since he dws them more rapidly, contnbutes 
less time to the total and to the average. Therefore the mean 
m the first case, in which all work the same amount of time, is 
more largely baaed upon the work of the abler than of the 
poorer pupils, whereas the reverse is true if all work the same 
number of problems. As a result the mean in the first case is 
higher than that in the s<‘cond. 

The formula for the harmomc mean (abbrexuated H, Mg, 

” This 18 true liecaase, although the entries in eolumn 3 are not the 
reciprticals of those in column 1 in the sense that each represents the quo- 
tient of 1 divided tiy the corresiHinding entry in eidumn 1, they are never- 
theleas reciprocal in nature since each represents 60 divided by the cor- 
responding entry in column 1 and are therefore in the same ratio to one 
another as are the corresiKimling entnea in column 2 The same is true 
with regard to columns 1 and 4 Also the eiitncs in the second and third 
columns state the same facts, except tliat in the second column the time 
is expressed in terms of hours, m the third in terms of minutes. That is, 
the second, which is headed ' Reciprocal of Numltcr of Problems per 
Hour," might also tie headed 'Numlver of Hours jier Problem," as the 
two mean the same thing Since this column has its entnes in hours, those 
m column 3 may be obtained from them by multiplying each by 60 In 
a similar way the entnes in the first column are 60 times the oorreepond- 
ing ones m the fourth That is, column 4 might properly be headed 
“Number of Problems per Minute," and since column 1 is the number 
of problems per hour, the corresponding entnes are of course 60 times as 
great. 
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otHM) is 



It is sometimes convenient to change it to the form 

1 _ U.1 

~H ~ N-^X 

Substituting in the first of these from column 1 of Table XIX, 
we have. 


H = j — -j 6 problems per hour. 

15 l2 10 6 4 3 


Using the second form, 


2 

H 


6 Vl5 12 


^ J_ ^ 1 -|- 1 ^ 


0 


1 

6 


whence = 6, as above. 

It sometimes happens that one desires to find the harmomc 
j mean of measures tabulated in a frequency distnbution. 

7 ()_ 4 The process of doing this is strictly according to formula. 

60- 6 To illustrate this use may be made of the distnbution 

50- 5 at the nght. The mid-point of each class is taken as 
^ the value of the cases (herein and therefore as the 

2 Q_ 2 denominator of the corresponding fraction and the 
N ■ ^ frequency in that clas.s as the numerator of the frac- 
tion. Hence for these data, 

20 

H = ^ = 53.79. 

— 4- — 4- 4- i*- 4. 4- 

25 ^ 35 45 ^ 55 65 ^ 75 

No general rule can be laid down as to when to use the har- 
monic mean and when the; anthmetic mean of data involving 
both amount and rate. Which is more appropriate depends upon 

** In practice it is often better to use decimals matead of common (mo- 
tions. 
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the point at issue, or the conditions under which the data have 
been secured. 

In case two sets of data are being compared the arithmetic 
and the harmonic means, if superficially interpreted, sometimes 
lead to different cfmclusions For example, let the following be 
the records of one group of four pupils in terms of examples 
solved in the same time. 2, 4, 4, and 6 For another group 
assume that they are 3, 3, 4, and 6 One, might conclude that the 
abilities of the two groups were almo.st exactly the same, since 
the arithmetic means of both groups are four problems per time 
unit If, however, the harmonic means are obtained, the situa* 
tion appears otherwi.se For the first group 


H = 


2 ' 4 4 6 


3.43 


whereas for the second group 
H = 


3 ^ 3 ^ 4 ^ 6 


= 3.69. 


If both groups work the same amount of time, they will average 
the same number of examples, but if they work the same number 
of examples, the latter group will average more. 

It will b(' noted that the harmonic means computed in this 
section are leax than the corresponding arithmetic means. That 
condition is not pi'cuhar to them, but is universally true. It is 
also true that the harmonic mean of a series of measures is always 
less than their giamietnc mean. 

A simple relation-ship exu-it-^ Ix'twecn the anthmetic, geomet- 
ric, and harmonic means of the same measums, which is veiy 
oonvement to use to determine the third if the other two of them 

fr* (7* 

are known. It is G = \ MH, whence H - and Af = 
Also, if deviations are small compared with the mean, so that 
the third and higher powers of ^ may bt> negknjted,’* two sets 

’* The symliol x ib commonlj' used to denote the deviation of a measure 
X from the mean of the aeriee. 
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of approximate equations connecting these three averages and 
the standard deviation have been worked out. One set gives 

M = VO* 4- O'* or ^ 4- 

G — y/M* — tr* or <r’ + and 


The other yields 



, G = M- 2 ,g. and H = M- 


ff* O'* 

Af ^ 4Af •' 


Readers who have difficulty m und('r8tanding the significance 
and interpretation of the hannonic mean may be helped by 
consulting a short article by Shen '’In this he gives a definition 
somewhat different from that given above and also a different 
but equivalent formula. 

The use of averages. The que.stion naturally arises as to 
which one of the averages or mi'asures of central tendency 
should be used m vanous cases The geometric and harmonic 
means may be omitted from the body of the discussion as being 
appropriate in particular cases only. Likewise, the mid-score 
need not be considered, sinci* whatever is said about the use of 
the median in a frequency distribution likewise applies to the 
use of the mid-score m a simple si'ries Wc may therefore con- 
sider the advantages and disadvantages of using the mean, 
median, and mode. 

According to Yule there are six criteria that a good average 
should meet. These are as follows; 


“ See p. 123 for the standard deviation. 

" Eugene Shen, “A Note on the Definition of the Harmonic Mean," 
Journal of EduccUxonal Psychology, Vol 22, April, 1931, pp 311-312. 

“ G Uduy Yule, An IrUroductum lo the Theory of Etalwltre, ninth edition, 
revised (London, Charles Griffin & Co , Ltd , 1929), pp 107-108. 
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1. It should be rigidly defined mathematically, 

2. It should be based on all the measures 

3. It should be readily comprehensible, that is, not too 
mathematically abstract. 

4. It should be calculated with reasonable ease and rapidity. 
6. It should be stable, that is, it should not be seriously 

affected by fluctuations of sampling.** 

6. It should lend itself readily to algebraic treatment. 

The following discussion will show how each of the three 
averages meets these criteria and further state certam advan- 
tages and disadvantages connected with their use 

The mean is exactly defined mathematically, and is not only 
based on al l the measur es but on their exact magnitudes It is 
w<^ known and therefore easily understood. It is not very 
difficult to calculate, although more difficult than either the 
median or thi- mode. The mean is usually least affected by errors 
of sampling. It also lends itself readily to algebraic treatment. 
For example . 

a. The algebraic sum of the deviations from the mean is 
aero Expressed in algebraic symbols, this is = 0. 

b. The mean of a whole senes may bt' e.xpressed in tenns of 
the means of parts of the senes. In algebraic terms, 

M = , 

in which 


N = N, + Nt + ... N„ 

c The mean of the sums or differences of corresponding 

'* If an average is being eoniimted for one set of data without regard 
to whether or not they are representative of other similar data, there is 
no place for the application of this criterion. If, however, as is often done 
to save lalxir and exjiense, one set or a comparatively few sets of data are 
being taken as representative of a much larger qiiantitv of data of the 
same sort, it is imiairtant that the average used should be stable or reh- 
aWe That is, if other averages are found from other repreeentative seta 
each containing the same nuiulier of cases the dilTerenees between these 
averages should lie small One of the most common examines is the inea»> 
urement of a few classes of pupils as representative of ail those of the 
•ame age, or grade, m a given school system or in a group of systems. 
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measures in two series is equal to the sum or difference of the 
means of the two series. That is, if 

X = Zi ± X2 =t . . . X„, Af = Ml ± Ms ± . . . Mn 

d. The sum of the squared dev'iations from the mean is a 
minimum, that is, is a minimum 

The mean can also be shown to be the most probable v^alue 
of any single measure of the senes It may be computed without 
knowing the exact magnitude of each measure, provided the 
sum and the number of measuri's are known Its calculation is a 
step m secunng the most commonly used measures of variability 
and relationship. In short, the mean satisfies the six criteria 
given above to a rather high degree and has a number of other 
desirable propierties with vcrj' fiwv undc'Sirable ones It is, 
therefore, recommended by statisticians as the best of the three 
averages for general use. 

The median also satisfies the criteria given fairly well. It is not 
so rigidly defined as the mean, but is based upon all the measures 
in the senes, although not upon their exact magnitudes It is 
more easily calculated than the mean, and although not so 
commonly understood can be easily explained. The fluctuations 
due to sampling are usually .■somewhat, but not markedly, 
greater than m the case of the mean. It is not susceptible of 
algebraic treatment Extremi' or erroneous values ha\'e com- 
paratively little effect upon it, whereas they may have a con- 
siderable effect upon the mc'an The grouping of measures m 
different classes usually affects ’I but slightly If the signs are 
neglected the sum of the deviations from it is a mimmum. The 
median easily ranks second to the mean m value It should be 
used when the undue influence of extreme or (-rroneous scores is 
especially undesirable, when the exact magnitudes of all scores 
are not known, or when ease ir. computation is important. 
Apparently because of the ease of computing the median, it 
has become practically the only measure of central tendency used 
in reporting standardized test scores. 

The crude mode has fewer good points and more points of 
weakness than either the mean or the median. It is not rigidly 
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deOned, nor is it based on all the measures. Instead, its position 
is determined by a comparatively few measures and may be 
markedly changed by the shifting of a few cases. Therefore it is 
by far the most unstable of the three. It is easily understood and 
found, no calculation at all being involved It does not lend 
itself to algebraic treatment. It may be determmed without 
knowing the magnitudes, locations, or sum of all the measures. 
The fact that it is determmed by the largest group of measures, 
and thus repre.sents the most frequent or the most typical 
measure, makes it in one wmse most representative of the whole 
distribution It should be used only when this quality is de- 
sired or when extreme ease of determining an average is essen- 
tial The true mode is more stable, but also more difficult to 
compute, so that it ranks only slightly higher than the crude 
one. 

As has been suggested above, the fact desired to be brought 
out has an influence m determining which average should be 
used. In some cases it is desirable that e.\treme values of the 
variable direct ly affect an average , in ot hers t his is not desirable. 
Sometimes it i.h iwful to employ an a\ erage such that its product 
with the numlxT of casi's yields the sum; at other times this is 
not useful For exiunple, if in a small school sj-^stem the su- 
penntendeiit receive.s a .salary of $2500 and each of four teachers 
receives $1500, the mean i.s $1700, the mid-score $1500, and the 
mode $1500 If oik' desires an average that indicates the typical 
salary’ Ix'ing received by the teacher* the mid-score or mode 
should be used, whereas if om* wishes an average which may be 
used to show- the total amount being expended for teachers’ 
salaries, the mean slioukl lx chostm. 

One point that may well be mentioned here, although it 
apphcs with equal force to almost all statistical work, is that in 
general tht' data that are dealt with as one group, and of which 
single measures are computid, should be homogeneous. In the 
example of a superintendent and a numbt'r of teachers just 
given above, the total group is, from one standpoint at least, 
not homogeneous. Largely because it is not so, the me^n salary 
of $1700 does not accurately indicate the salanes received by 
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the individuals included. It is difficult to say just what con- 
stitutes homogeneity. A group of teachers and superintendents 
may be considered homogeneous as contrasted with a group of 
lawyers or of caipenters. When there is any doubt about this 
matter one will usually be on the safe side by dealmg with the 
data in separate groups at first, and later makmg such combina- 
tions as seem best. 

In the preceding discussion nothing has been said as to how 
well the geometric and harmonic means meet the cntena given. 
On the whole, they stand high when judged by the six criteria. 
They are decidedly weak with regard to the third point, since 
they are not understood by most persons They are also some- 
what difficult to compute. On th(‘ first two points there is 
nothing at all to be desired and on the last two they rate high. 
For the geometric mean several genc'ral conditions more or less 
aitnilar to those stated for the arithmetic mean hold. The three 
most important of these are probably as follows: 

а. If a measure is the product of sevc'ral other measures, the 
gecnnetnc mean of the first measure is equal to the product of 
the geometric means of the other measure. In algebraic terms, if 
X — Xi'Xf . . . Xnt then Gx — Gi . . . Gn. 

б. If a measure equals the quotient obtained by dividing one 
measure by another, its geometric mean equals the geometric 
mean of the fiirst divided by that of the second, that is, if 



c. The geometric mean of a whole senes may be expressed in 
terms of the geometne means of the vanous portions of the 
series. Expressed algebraically 

G« = . . . G/- or G = ^G^iG^x . . . 


Exercises 

^ 1. Compute the mean, by the short method, for each of the following 
distributions. Check each mean by a second computation with a 
different assumed mean. 
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A 


B 

C 

D 

E 



/ 

/ 

/ 

/ 


/ 

90- 

2 

44- 2 

760- 2 

8.0- 2 

100- 

3 

80- 

5 

42- 0 

725- 7 

7.5- 3 

95- 

2 

70- 

7 

40- 3 

700- 14 

7.0- 0 

90- 

6 

60- 

11 

38- 4 

675- 18 

6.5- 5 

85- 

8 

50- 

14 

36- 6 

660- 33 

6.0- 7 

80- 12 

40- 

19 

34- 5 

625- 54 

5.5- 8 

75- 

9 

30- 12 

32- 4 

600- 41 

50- 9 

70- 

11 

20- 

6 

30- 1 

675- 29 

4.5- 6 

66- 

2 

10- 

2 

28- 1 

560- 17 

4.0- 4 

60- 

2 

0- 

1 

N = 26 

525- 6 

3.5- 3 

N = 

55 

N - 

79 


500- 3 

30-3 






N = 224 

A' = 50 




2. Compute the median of each distribution in Exercise 1. 

3. Compute the median of each of the following distnbutions: 


A 

/ 

B 

/ 

C 

/ 

D 

/ 

E 

/ 

45- 

1 

140- 16 

lO 2 

78- 

1 

96- 2 

40- 

2 

130- 9 

9- 3 

75 

1 

94- 1 

35- 

4 

120- 5 

8- 0 

72- 

6 

92- 3 

30- 

1 

no- 2 

7- 6 

69- 

7 

90 4 

25- 

2 

lOO- 0 

6- 9 

60 

12 

88- 5 

20- 

5 

90- 4 

5- 14 

65 

8 

80 0 

15- 

2 

80 7 

4- 15 

60 

4 

84- 0 

10- 

4 

70 10 

3- 10 

57- 

0 

82- 0 

5- 

3 

60 11 

2- 5 

54- 

2 

80 6 

0- 

N - 

31 

55 

A' = 64 

1- 3 
O 1 

A^ = 68 

N = 

41 

78- 5 
70 3 

N = 2Q 


4. Find the mid-score of each of the following senes 

A. 44, 50, 40, 48, 29. o9, 35, 45, 52, 69, 13, 42, 56, 55, 50, 59, 41, 

50, :i4, 67, 43, 41, 54 

B. 12, 7, 13, 8, 2, 8, 11, 9, 18, 3, 4, 8, 9, 8, 4, 4, 9, 7, 17, 9, 10, 8, 10, 

8, 4, 8, 1, 4, 3, 7, U), 7 

C. 103, 108, 98, 106, 88, 119, 94, 105, 111, 129, 71, 101, 116, 116, 

101, 117, 100, 108, 92, 125, 103, 99, 115, 133. 

D. 16- 11, 18- 0, 17- 6, 17- 8, 17- 1, 16- 4, 17- 0, 16- 8, 

16- 9, 16- 5, 19- 6, 17- 5, 16- 5, 16- 0, 17- 3, 17- 9, 

17- 5, 18- 0. 18- 9, 17- 6, 16- 6, 18- 2, 16- 2, 17- 1. 

5. Find the empincal or cnide mode and the mode by each of the 

two formulte given m the text for each distribution in Exercise 1. 
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6. If the enrollment in a certain high school was 248 in 1925, and 
364 in 1929, what was the average annual rate of increase? 

7. If the per capita cost of instruction rises from $75.42 to $147.20 
in ten years, what is the average annual rate of increase? 

8. If a child’s weight is 92 lbs on September 1 and 86 lbs. on May 1, 
what 18 the average monthly rate of decrease? 

9. Fmd the haimomc mean of each of the folio wng distributions. 


A 

B 

C 

D 

Words 

Examples 

Yards 

Letters 

per 

per 

])er 

per 

Mmute 

Hour 

Second 

Second 



/ 

/ 

8 

28 

10- 2 

6- 2 

6 

24 

9- 3 

5- 2 

5 

22 

8- 6 

4- 5 

5 

21 

7 7 

3- 4 

4 

19 

6- 4 

2- 3 

3 

17 

5- 2 

1- 1 

3 

13 

N = 24 

A = 17 


2 12 
11 
8 



CHAPTER VI 


QUARTILES, PERCENTILES, AND SIMILAR 
MEASURES 

Quartiles. It is frequently useful to determine certain other 
points on the scales of distnbutions than those which express 
the central tendency Such points are similar to the median 
in that they are detiirrained according to the fractions or per 
cents of all the casi's in the distribution above and below them. 
Their names indicate what these fractions or per cents are. 
Of such points the quartiles are by far the most common. As 
their name indicates, they arc those pomts which divid e the 
distribution into four parts, each containi ng the same n umber 
of^st‘ 8 .* There are, therefore, three of them The^ first or 
lower quart lie, abbreviated Qi, is tha t Douit belog -nt..^ which 
the^an* one-fourth of the cases in the distnbutiob and above 
or at which there are thit'i'-fourths The second quartile, smce 
it 18 that pomt at or below which there are two-fourths and 
at or above which there arc two-fourths of the cases, is the 
same as the median, therefore the term is almost never used. 
The third or upper quartile, ab brev iatitl Qs, is the point at or 
below which an' thn'e-fourths of th<> cases m the distribution, 
an 3 lit or above which an- one- fou rth. 

The method of computing the first and third quartiles is 
the same as that for the median except that the first term 


N 

of the numerator in the fraction is y or 


3.V 

X’ 


as the case may 


' Sonictimw the expression quartUe is applied to each of the parts into 
which a distribution is divided rather than to the points that divide it, 
but this IS not the conveiitioiiid iLsagc, and should tie avoided in order to 
prevent confusion Instead, tlie term qtutrter or fourth should be used for 
Buch a part Thus the portion of a distnbution below the first quartile 
should lie called the first or lower quarter or fourth, that from the first 
quartile up to the median the second quarter or fourth, and so on. 

105 
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be, instead of The formulae for the two quartUes are, there- 
fore, as follows; 


r-^ 

Qi = 2 H -j — h and 

3N ^ 

4 

Qi = I j — *• 


It is, of course, also possible to compute them by counting 
down from the upper limits rather than up from the lower 
ones. This is almost never done for the first quartile, but is 


TABLE XX 

Computation op this 
Quartiles 


/ 


75- 3 
70- 5 
65- 6 
60- 6 
65- 6 
60- 4 
46- 2 
40- 2 
35- 3 
30- 1 
25- 1 
20-_l 
N = 40 


not uncommon for the third, since that 
18 much nearer the upper end of the dis- 
tribution than the lower. The formula 
for the third quartile by this method is 

Qz = u - —j — i. 

The distribution in Table XX may be 
employed to illustrate the computation 
of the quartiles For it 

r - 

Q, = 50 -f- — ^ — 5 = 50, and 


Q. 


60 + 



60 


Q, = 65 -I- 


- 26 

^-5 = 68.33, 


_ 26 or, applying the other fonnula, 

Q, = G5-t--i— 5 - 68 33 or 40 

D 3 g 

- g Q, = 70 - --^5 = 68.33. 

Q, . 70-i-~5 - 68.33 

To make the computation of 
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the qnartiles still clearer, a second example will be given in 
Table XXI. For these data 

4 


- 21 


Qi = 1400 + 


22 
3 100 


-100 = 1418.18, and 


Q, = 1700 -I- 


Q, = 1800 - 


- 69 


100 

4 


8 
- 23 


-100 = 1775, or 


8 


-100 = 1775. 


TABLE XXI 

CkjMPCTATIOM OF 

Qcabtiim 


THX 


It 18 sometimes desired to find the quartiles of simple or un- 
grouped senes The method for this is similar to that for the 
mid-score, but its detailed application is 
easiest if slightly varying methods are 
used according to the total number of 
cases in a distribution If each measure 
is a mid-value, that is, for example, a 
measure given as 6 represents 5 5 up to 
6.5, one of 7 represents 6.5 up to 7 5, and 
80 on, the quartiles may be found as fol- 
lows: 

If the number of cases m the senes is 
an even multiple of 4, the first quartile 

is the point midway bctw'een the ^th 

and the next case when the senes is ar- 
ranged in ascending order and the third 
quartile the point 
midway between the 

-^tb and the next 

case. To illustrate 
this, for the follow- 
ing series of twenty 
scores: 28, 36, 43, 47, 

49, 51, 53, 56, 56, 59, 


<?, - 1400 -t- 


100 

4” 


- 21 


2200- 

6 

2100- 

2 

2000- 

4 

1900- 

5 

1800- 

6 

1700- 

8 

1600- 

10 

1500- 

16 

1400- 22 

1300- 

14 

1200- 

7 

N - 

100 

100 - 1418 18 


3 100 


- 69 


0, - 1700 -I- 


-100 - 1776 OT 


100 


- 23 


Q, - 1800 - 


-100 - 1775 
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62, 62, 64, 65, 68, 69, 70, 72, 74, 77, the first quaxtile is mid- 
way between the jth or fifth and the next, or sixth, score, and 

the third quartile midway between the -^th or fifteenth and 

the sixteenth scores. Therefore Qi — 50, midway between 49 
and 51, and = 68.5, midway between 68 and 69. 

If the total number of cases is one more than an even multiple 
of 4, the first quartile is three-fourths of the distance from the 

^^th case up to the next one and thi' third quartile one-fourth 

of the distance from the -- — — th case up to thi' next Thus for 

4 

the series 4, 5, 6, 6, 7, 9, 9, 9, 10, 11. 12, 12, 14, 15, 16, 18, 19, which 

Y — 1 

contains seventeen cases, ^ - = 4, therefore = 6 75, three- 


fourths of the way from the fouith case up to the fifth, and 

^ = 13, so Qs = 14 25, oiK'-fourth of the way from the 

thirteenth up to the fourteenth 

If the number in the series is two more than an even multi- 

.\' -f 2 

pie of 4, the first quartile is the -^--th case and the third 
3jY -)- 2 

quartile the — ^ — th case For example, if a case at 20 be 

added to the senes in thi' preceding paragraph, so that it has 
-F 2 

eighteen cases, — — = 5, so Qi = 7, the fifth case, and 

~ ^ 4 ~^ ^ 80 Qs= the fourteenth case. 

If the number of cases is three more than an even multiple 
of 4, the first quartile is one-fourth of the distance from the 
JV-f 1 

— ^ — th case up to the next one and the third quartile three- 

3JY — 1 

fourths of the way from the — ^ — th case up to the next. 


Thus if the last two scores, 18 and 19, are dropped fnim the 
senes in the second paragraph above, leaving fifteen cases. 
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N + 1 
4 


4 and 


SN-1 

4 


= 11, whence Qi = 6.25 and Qt = 12. 


If each measure is considered as a lower limit, that is, if 6 is 
taken as meaning 6 up to 7, 7 as 7 up to 8, and so forth, the 
quartiles are usually one-half of a scale unit larger than those 
obtained from the formulae just given. In case two or more 
cases having the same scores fall at a quartile point, however, 
the quartile is the same as the scores falling there. 

If the measures are taken as exact, not representing dis- 
tances on the scale, and if the total number in the distribution 
is an even multiple of 4 or two more than such a multiple the 
quartiles are obtained in the same way as desenbed above for 
measures considered as mid-values. If the number of cases is 
one or three more than an even multiple of 4, the quartiles are 
generally * one-half of a scale unit less than those when the 
measures are assumed to be mid-values. In other words, for a 
series of one more than an even multiple of 4, Qi is at one- 

A' - 1 

fourth of the distance from the — r — th case up to the next 


one, and Qt at three-fourths of that from the 


3.V - 3 . 

— 7 — th case up 


to the next. Sunilarly, for a senes of three more than an even 
multiple of 4, Qi is at tliree-fourths of the distance from the 
N — 3 

— ^ — th case up to the next, and Qt at one-fourth of that from 
3.V — 1 

the — th case up to the next. Appljnng these, Qi = 6.25 


and Qi = 13 75 for the st'nes of seventeen scores given above, 
and Qi = 5.75 and Qt — 12 for that of fifteen. 

Percentiles. Next to the median and the quartiles the per- 
centile points are the most commonly employed measures of 
this general type. They ar e the poi nts that divide a distribu- 
tion int o one hundred equaTparts each of which contains 1 per 
cent of the total number of cases. Unless a distribution con- 
tuns a large number of cases, at least several thousand, it is a 
waste of effort to divide it into one hundred equal parts, since 


‘ The exception is the same aa that mentioned in the preceding para- 
graph. 
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the number of cases in each is too small to be significant. More- 
over, there is rarely a need for such a fine division of a distribu- 
tion. For these reasons only a comparatively few of the per- 
centiles, rarely exceeding twelve or fifteen and frequently no 
more than five or seven, are usually determined. For purposes 
of reporting test norms it is very common to use the fifth, tenth, 
twenty-fifth,* fiftieth, seventy-fifth, ninetieth, and ninety- 
fifth. Sometimes also the first and second and nmcty-eighth 
and mnety-nmth are given, sometimes each tenth one, and 
sometimes others. 

The same general formula that is employed for the median 
TABLE XXII quartiles is used for finding a desired 

Computation of percentile of a distribution, the proper change 


Pbhcentiles 

/ 

21200 - 6 
2100 - 2 
2000- 4 
1900- 5 
1800- 6 
1700- 8 
1000 - 10 
1500- 16 
1400- 22 


being made in the first term of the numerator 
so that it represents the desired fraction or 
piercentile To illustrate this the fifth and 
tenth percentiles of the distnbution of one 
hundred cases used in the section on the quar- 
tiles and elsewhere may be found as follows. * 


Pt, = 1200 -t- 



100 = 1271 43, and 


1300- 14 
1200- 7 

N - 100 


Pio = 1300 + 


moo _ ^ 

100 = 1321.43. 


P. 

Pio 


5 100 

loo 

- 1200 H y 100 = 1271 43 

10 100 

— 7 

100 

“ ■< U 100 = 1321.43 


These are to be in- 
terpreted in a fashion 
similar to the quar- 
tiles, that 18 , that 6 
per cent of the cases 
in the distribution are 


* The twenty-fifth percentile is the same as the first quartile, the fiftieth 
as the median, and the seventy-fifth as the third quartile, but when other 
percentiles accompany them it is common to refer to all by then ncrcentile 
designations rather than to use the other terms. 

‘Percentile is sometimes abbreviated by P and sometimes by Per In 
eithta- case a subecnpt should foUow indicatmg what percentUe is meant 
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and consequently 95 per cent of them are at or above that point, 
and that 10 per cent of the cases are at or below 1321.43, and 
the remaining 90 per cent at or above it. 

Smce percentiles above the fiftieth are nearer the upper than 
the lower end of the distribution, it is frequently the practice 
to determine them by the use of the other formula, that is, by 
working down from above. Thus the eighty-fifth percentile erf 
the given distnbution, for example, may be found as follows: 

15 100 _ 

Pai = 2000 - 100 = 1940. 

o 

or, in other words, by counting down 15 per cent from the upper 
end of the distnbution 

It 18 imp<irtant to remember in connection with percentiles, 
as with all points of this general sort, that the larger the sub- 
senpt, the higher the rank or position m the distnbution. This 
follows from the fact that such a pomt indicates what portion 
of the total distribution is at or below it, and that, therefore, 
the larger the subsenpt, the greater is this proportion. 

Changing ranks to percentiles. In comparing or combming 
scores, procedures which wall be dealt with m Chapter XXII, 
it IS fn^quently coriveuient to change ordmary ranks mto per- 
centile ranks or scores This can readily be done by the following 
formula 

r,rw . . , X 2R - lOOR - 50 

PR (percentile rank) = — 100, or 


in which R stands for the rank of the case m its series given on 
the basis of one representing the lowest rank and so on up. For 
example, in the twenty spelling scores referred to a number of 
times previously, the pupil who made a score of 47 ranks fourth 


from the bottom among the twenty. His percentile rank, there- 

, , 100-4 - 50 c 

fore, equals 17.5. 


It is impioBBible to have a percentile rank of zero or one hun- 
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died since no case can be lower or higher than every case in the 
distribution including itself. For example, in the series of 
twenty scores 77 is the highest or, in other words, rank 20. The 

percentile rank of this score is ^ = 97.6, which is the 

highest possible percentile rank in a group of twenty. This 
illustrates the general fact that the highest jxissible percentile 

60 

rank in any group is equal to 100 — ^ Correspondingly the 

50 

lowest possible percentile rank m a group is equal to Y" 

Occasionally it is desired to rei'erse the process and find the 
ordmary rank in a group when (ho percentile rank is already 
known. The formula for this is 


R = 


N PR 
100 


+ iorff 


N PR + 50 
“lOO 


Therefore if one desires to find the ordinary rank of an individual 
whose percentile rank is 17 5 in a group of twenty, the result is 

^ This, it will b<‘ noted, agrees with the reverse 


illustration above, in which the individual who ranked four m a 
group of twenty was found to have a p(*rc(*ntile rank of 17.5.* 
To assist in the determination of percentile ranks from or- 
dmary ranks, tables have been prepared by various workers. 
Probably the best table of this sort is that prepared by Buros 
and Buros.' It gives the percentile rank for each ordinary rank 
for all numbers of cases from 1 1 up to 100. In it ordinaiy ranks 
are taken just the reverse of those previously used in this dis- 
cussion; that IS, a rank of one is given to the highest, not to the 
lowest, score, and so on down 

Other similar measures. There is no limit to the number of 
measures similar to quartiles and percentiles that may be 

‘ For a good discussion of percentile ranks and some of their uses, see: 
Arthur S. Otis, Stalulxcal Method tn Educattonal MeaauremerU (YorJeem- 
on-Hudson, World Book Co , 1925), Chs. ix and xi 
• Francis C Buros and Oscar K Buros, “Expressing Eklucational Meae* 
uree as Percentile Ranks,” Test Method Helps, No. 3 (Yonkere-on-Hudsem 
Worid Book Co., 1930), 27 pp 
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eomputed, but few of them are much used in actual practice. 
Tertilea, representing division into three parts, quirdilea that 
mto five, and deciles, that into ten, are probably the only ones 
with which the reader needs to be at all familiar. Even 
the latter two of these are rarely encountered, but instead 
the corresponding percentile points are usually employed. The 
general formula for these is the same as for the median, the 


f 



0 2 4 6 8 K) 12 14 1£ 18 

Scon 

FIG. 30 GKAPniC KCPRRSENTATION OF MEDIA.N', QUARTILES, 
AND OTHER .•^l.MILAU MEASURES 


quartiles, and the fiorcentiles, the proper modification bemg 
made in the first ti'nn of the numerator 

It 18 also p)ossii)!(' to change ordinary ranks into ranks based 
on any of thest' di\ ision.s, as well as into percentile ranks. The 
only difference m tlu* formula employed m any particular case 
is that the UK) that apjK-ars in the formula for percentile rank 
is replactal by a number that indicates the number of divisions 
being considered Tins general formula may be given as follows, 
using X to stand for the desinal rank 

2R - 1 

XU = y - A' or XR = -- 


The reverse formula, that is, the one for finding the ordinary 
rank from the point rank is 

„ NA-. 1 ,, + t 

orfl= X 
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To aid in understanding the meamng of points of the sort 
dealt with in this chapter, Figure 30 is given. It represents the 
distribution tabulated beside the figure and shows graphically 
the median, the first and third quartiles, the fifth and nmety- 
fifth percentiles, and the first and second tertiles thereof. The 
fifth percentile is 1.60 and the vortical line erected from that 
point on the base-lme scale up to the upper bounding line of the 
figure has 5 per cent of the area of the figure to its left, that is, 
below it, and 95 per cent to its nght, or above it. To take a 
second case, the first tertile is 5 78, and so below or to the left of 
the vertical Ime erected above this point on the base-lme scale is 
one-third of the area, whereas above it, or to its right, are two- 
thirds. 

Exerci.^e.-' 

1. Find the first and third quartiles, the fifth, tenth, and ninetieth 
percentiles, and the first and second tcrtile-s of each of the following 
distributions. 


A 


B 

C 

D 


/ 

/ 

f 

I 

26- 

2 

75- 2 

950- 1 

88- 3 

24- 

3 

70- 8 

900- 0 

84- 5 

22- 

5 

65- 19 

8.50- 3 

80- 8 

20- 

6 

60- 37 

800- 7 

76- 14 

18- 

8 

55- ,55 

7.50- 9 

72- 21 

16- 

14 

50- 69 

700- 12 

68- 24 

14- 

11 

45- 41 

650- 16 

64- 26 

12- 

7 

40- 21 

6(K)- 10 

60- 20 

10- 

3 

35- 11 

5.50- 7 

56- 18 

8- 

0 

30- 4 

500- 2 

52- 16 

0- 

N = 

1 

60 

N = 267 

N = 67 

48- 13 
44- 5 

N = 173 


2. Find the percentile corre-sponding to each of the following ranks: 
A, fourth among 22; B, eighth among 11 C, seventy-third among 124; 
D, twenty-eighth among 35. 



CHAPTER VII 

MEASURES OF VARIABILITY 

General discussion. A distnbution is not sufficiently de> 
scribed by stating merely its average. A second important fact 
is a summary statement of the amount of di.sp('rsion around the 
average Two or more distributions or curv-es may have the 
same average, but differ greatly because of different vanabilities. 
This fact IS illustrated by Figure 31, which shows two such 



FIG 31 CURVES WITH SAME AVER.\GE BUT DIFFERENT 
VARIABILITIES 

The curve reprcw'uUxl liy the solid line has leas variability than the other ana, 

curves. Both an' symmetrical and both have the same average, 
but the one represented by the broken line contains measures 
that on the whole an' further away from the average than does 
the one represented by the solid Ime. That is, if the two curves 
represent distnbutions of similar data, those represented by the 
broken line are loss homogeneous than the other set. 

Diaperstion or variabihiy, also called variation, spread, scalier, 
fluctuation, and (Aviation, may be expressed in terms of any one 
of several measures. The fairly common ones are the raiyje, 
sometimes called the total or absolute range, the quarlUe demotion 
or semi-interquartile range, the 10-90 percentile range, the mean 
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deviation, the standard deviation, and the which 

i s fre quently inappropriately called the probable enyr. 

AH the measures of variability named above are absolute 
numerical expressions that state m terms of base-lme distance 
how great the dispersion or scatter is. Therefore they cannot 
be used to compare two distnbutions that have different scales. 
To enable one to do this relative measures are needed. Such 
measures, called coeffieienls of vanalton or variability, will be 
discussed after the various absolute measures have been con- 
sidered. 

A measure of variabibty is a distance on the scale. This 
distance is usually measured from an average and includes a 
definite proportion of all the casi's Not infrequently a measure 
of variabihty is used as a unit distance in tenns of which to 
express the distance of any particular measure from another 
measure or from an average. For example, one may speak of one 
point being 2 mean deviations, or 3 4 standard devaations, from 
another. Most uses of measuri's of \ anability are based on the 
assumption of a symmetncal di.sfribution of scores, and unless 
this assumption is true some error is present If a distribution 
is only moderately asymmetrical, however, the error is not so 
large but that it generally may b<‘ neglected. 

The range. The range is the mo.st easily computed of the 
measures of variabihty, but it is tlii' least reliable and, for most 
purposes, the least useful. It is the (h.'^tance on the scale from the 
lowest measure to the highest one and, therefore, is obtained by 
subtracting the former from the latter It shows the total scale 
distance covered by the distribution. For a simple senes it is 
very easily obtained. For example, the range of the senes of 
twenty scores previously uw'd a number of times is 49, obtained 
by subtracting the lowest, 28, from the highest, 77. 

In the case of a frequency tabulation there is slightly more 
labor required to determine the range. In fact, the exact range 
cannot be given in such a case, it is evident that the lowest 
score in the accompanying tabulation cannot be smaller than 
20 or so great as 25, and that the highest cannot be smaller 
than 75, or so g;reat as 80. Therefore the greatest possible 
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range is from 20 to 79.99 ... or 80, se it is usually taken, whidi 
gives 60, and the least possible from 24.99 ... or 25 to 75, 
which is 50. Since the range cannot be determined j 
exactly in such a case, there are various practices fol- 75- 3 
lowed in giving approximate ranges. One is simply to 70- 5 
state that the range is not greater than 60. Another ® 
is merely to say that it is 50 or more. A third and more ^ ^ 
common method is to give as the approximate range ^ ^ 
the distance from the mid-pomt of the lowest to the 45- 2 
mid-point of the highest cla.ss, in this case from 22.5 40- 2 

to 77.5, which is 55. Probably the most satisfao- 35- 5 
tory method, however, is to estimate the position of J 
the highest and lowi'st measures in the distribution 20. j 
according to the assumption of uniform distnbution ^ ^ 

within each cla.sa interval, and then determme the 
difference lietweon them. For the given distnbution the one 
case in the 20- interval is, of course, assumed to be at its 
raid-point, 22 5, and the largest of the three cases in the 75- 
class 18 assumed to bo at the middle of the upper third of the 
distance covered by that class, that is, at 79 17.‘ Takmg the 
difference between these, 56.67 is obtamed as the most likely 
value of the range. 

The quartile deviation. The quartile delation or semi- 
interquartile range is, as the latter name implies, one-half of the 
distance between the first and third quartiies. Its formula, 

therefore, is simply Q = ^ In this Q is used as the abbre- 

viation for quartile deviation. Another form of statement is 
that it IS one-half of that distance on the scale which includes 
the middle 50 per cent of the cases. If the distribution is sym- 
metrical, Q includes 25 pt'r cent of the measures, but as it be- 
comes more and more asymmetrical this becomes less and less 
true. 

' Since there are three cases lu this class, it is assumed to be divided 
into three equal parts with one case at the imddle of each The upper ol 
these parts, therefore, includes the upper one-third of the range from 75 
to 80, that IS, from 78.33 to 80 The mid-point of this, 79.17, is takoi aa 
the location of the largest measure. 
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The computation of the quartile deviation may be illustrated 
by emplosung the quartiles previously found on page 106. 
For the distribution from which they were determined, 
which is the same as that given in the preceding section, 
Q ^ 68 33 - oO 00 _ g 

Occasionally the quartile range, v\ hich is the distance between 
the first and third quartiles instead of half that distance, is 
employed as a measure of variability. Its use is rare and the 
writer does not recommend it since it is likely to be confused 
with the quartile deviation. 

The 10-90 percentile range. Although Kelley - has suggested 
that the 10- 90 percentile range is for many purpow's the most 
satisfactory measure of variabilitv, and although it is more 
reliable than any of the commonly employed measures of 
variability based upon percentil(\s,‘‘ it ha.s not come into general 
use. As its name implies, it is merely the distance between the 
tenth and ninetieth percentiles of a distribution, that is, the 
distance that includes the middle 80 piT cent of the cases It is 
better than the quartile deviation in that it is based upon a 
much larger proportion of the cas(‘s, but ai'oids the weakness 
of the range by e.\cluding a few cas(“- at (“ach end of the distribu- 
tion so that any decidedly uiiu.‘-ual e\l reiiie cases do not affect it. 

For the distribution already u.M'd in this chapter and else- 
where the 10- 90 percentile range may be found as follows; 



Pw = 35 + -..—5 = 36.67 

O 


Pm = 75 - “4 — 5 = 74 
5 

•Truman L Kelley, “A New Measure of Dispersion,” Journal of the 
American Statultccd Association, Vol 17, June, 15)21 , pp 743-749. 

• The range between the 6 917 and 93 083 j)ercentile8 has the highest 
rdSability of any percentile measure of vanability, but is rarely if ever 
employed because of the inconvenience involved in using such numben. 
The 10- 90 percentile range is only sLghtly less reliable 
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and, consequently D (Kelley’s abbreviation for the 10- 90 per- 
centile range), or Z)io- go, equals 74 — 36.67 = 37.33. The for- 
mula is merely Dio- «o = Poo — Pio. 

The mean deviation. The mean deviation, abbreviated MD 
at sometimes AD for average deviation, is exactly what its 
name implies, the mean of the deviations from an average. In 
obtaining it the signs of the deviations are neglected. It is 
possible to secure a mean deviation about any average, but in 
practice it is si'curcd around either the mean or the median. 
The former is more freijuimtly used, but the mean dev'iation 
is a minimum around the median. When the mean deviation is 
laid off m both directions from the mean or median it includes 
approximately 57 5 per cent of the cases within the points on 
the scale to which it reaches When computed for measures 
arranged in a frequency distnbution it assumes that they are 
concentrated at the mid-points of their respective intervals. 
As there is a general tendency for more measures to be on the 
side of the mid-point nearer the average than on the other side, 
this results m the mean deviation bemg slightly too large. 
Thorndike * gives a table of approximate corrections which 
may be applied Their size vanes from 02 of the width of 
the interval, if the distribution includes only six classes, to 005 
of the width, if it includes twenty. If more than twenty are 
included the correction is still smaller. The given correction 
is, of course, to be subtracted from the obtained mean devia- 
tion. In ordinary statistical work this correction is not appHed, 
since it is so small as to be neghgible unless a high degree of 
accuracy is desired. 

The direct method of computmg the mean devnation con- 
sists simply in finding the deviation of each measure from the 
average, suminmg these' deviations without regard to sign, 
and dividing by the number of cases It involves handling 
rather large numbers in case the distnbution is long and the 
average about which it is taken not a round number. There is 

* E L Thorndike, An Introduction to the Theory of Menial and Social 
Meaeuremente (New York, Teacheni College, Columbia Umversity, 1913), 

p an 
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a short method, however, which reduces the labor consideiv 
ably. It is based on the same computations as are made to 
secure the mean by the short method, and amounts to hndmg 
the mean deviation about the assumed mean or median and 
applying the proper correction. The formula is as follows : 

2/d + c(Ni - Na) + (.25 + c^)N„ 

MD = ^ 1 

The new terms in this formula are Nb, Na, and Nn- Nb is the 
number of measures in all classi's below or smaller than the 
one containing the true mean or nn'dian, and Na is the number 
in those above or larger. Nm is the number in the class which 
contains the mean or median 2/d is taken without regard to 
sign Applymg this formula to the data m Table XXIII the 

TABLE KXiU 

Computation op the Mean Devia- 
tion ABOUT THE .Me^N 


f 

it 

f'i 

75- 3 

+ t 

+ 12 

70- 5 

+3 

+ 1.5 

65- 6 

+2 

+ 12 

60- 6 

+ ' i 

+ 6 

55- 6 


+45 

50- 4 

- i 

- 4 

45- 2 

-2 

- 4 

40- 2 

-3 

- 6 

35- 3 

-4 

-12 

30- 1 

-5 

- 5 

25- 1 

-6 

- 6 

20- 1 

-7 

- 7 

At - 40 


-44 


40 1 + 1 
c = 025 

45 + 44 + 025(14 - 20) + ( 25 + 025“)fi 
MDm -5 - 11.29 


following result for the mean deviation about the mettn jg 
obtained . 

MDm = 45 + 44 + .025(14 - 20) + (-25 -f .025«)6 , ^ 
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In this computation 2/d is 89, the sum of 45 and 44; c is .025; 
Nh is 14, obtained by adding the frequencies of all the classes 
below the 55- class; Na is 20, the sum of the frequencies of 
classes above the 55- class; N„ is 6, the number of cases m the 
55- class; t is 5, and N is 40. Substituting these, as shown, 
gives a mean deviation around the mean of 11.29. 

It should be noted that the correction, c, retains its sign. In 
the example given it happens to be positive, but if it is negative 
the mmus sign should be kept. It is a Limitation of this formula 
that it applies only when c is not less than — .5 and is less than 
+ .5. If the assumed mean has been so taken that c is outside 
these limits, it is best to assume another mean so that this will 
not be the case. It is possible to secure the mean deviation with 
an assumed mean that differs by more than one-half mterval 
from the true moan, but the process of so doing is difficult. 

The computation of the mean deviation about the median 
differs only m that the correction used is the difference between 
the true and assumed medians instead of between the true and 
assumed means. The assumed median is taken m the same 
manner as the assumed mean, that is, it is the mid-point of the 
class m which the median falls. If the distnbution is approxi- 
mately symmetrical it will usually be the same as the assumed 
mean. To determme the correction, the true median must be 
computed and the difference between it and the assumed me- 
dian divided by the class interval. In this case the median is 
60. If the assumed median is taken at the mid-point of the 55- 
class it is 57.5, and the difference between it and the median 
is 2.5. Dividing this by the class interval, five, gives a value 
of -|-.5 for the correction. This requires choosing a different 
assumed median if the formula given above is to be employed. 
Hence 62.5, the mid-pomt of the 60- class, is taken and cud — 
0Q Q ^ 02 5 

g = —.5. Table XXFV contains the computation. 

2yd = 25 -f 64 = 89, JV» = 20, Af . = 14, and N„ = 6. Substi- 
tuting these and the values of c, i, and N in the formula, we have: 

25 -t- 64 - .5(20 - 14) (.25 -b .5»)6 g ^ 


MDud 
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TABLE XXIV 

COMPOTATION OF THE MkAN DEVIA- 
TION ABOUT THE Median 


MDud 


/ 

d 

fd 

75- 3 

-1-3 

-b 9 

70- 5 

-1-2 

-f-10 

65- 6 

-fl 

+ 6 

60- 6 

0 

-1-25 

55- 6 

-1 

- 6 

50- 

-2 

- 8 

45- 2 

-3 

- 6 

40- 2 

-4 

- 8 

35- 3 

-5 

-15 

30- 1 

! -6 

- 6 

25- 1 

—7 

- 7 

20- 1 

-8 

- 8 

N =» 40 


-61 

25 + 64 - 

5' 20 -141-1- 

. 2.'. -b .V)6„ 

40 


U 13 


This is smaller than the mean doMation about the mean, 11.29, 
thus illustratmg the fact that thi* mean deviation about the 
median is a minimum. 

Many texts in statistics give a formula for the mean devia- 
tion, simpler than the one given here, but not absolutely accu- 
rate, and yielding values slightly too small. The error is so 
slight that for most practical purpose's it may be' neglected, but 
nevertheless it seems undesirable to employ this formula when 
a more satisfactory one is know n Kelley ‘ and later Toops • 
have advocated the use of another fonnula. It is valid and 
much easier to apply in ca.ses of ungrouped senes, but for 
grouped series it involves the same unjustified assumption as 
does the mcorrect one referred to above. This assumption is 
that all the cases in a class are grouped at the rnid-point of that 

‘Truman L. Kelley, Statistical Method (New York, Macmillan Co., 
1923), pp 70-75. 

•Herbert A. Toops, “On Computing the Average Deviation from the 
Mean,” Journal of EdiuxUtonal Research, Vol. 15, January, 1927, pp. 4ft- 
61. 



MEASURES OF VARIABILITY 


123 


class whereas the more correct assumption is that they are 
symmetrically distributed throughout the class. In much of 
the work done with frequency tabulations m educational statis- 
tics the two assumptions lead to identical results, but in this 
case they do not. For further discussion of this point the reader 
is referred to Rietz.' 

The standard deviation. The standard deviation® is from 
the mathematical standpoint the most important measure of 
deviation or variability. It is frequently used in educational 
work, but probably no more often than one or two other meas- 
ures of the same characteristic. The abbrenation for it is small 
sigma (<r) or, less frequently, SD. It has become the accepted 
practice to compute the standard de\aation about the mean 
only. Similar measures may be computed about other aver- 
ages, but this IS rarely done, so that the standard deviation 
is the only miportant measure of variabihty based upon the 
squares of the deviations. 

The standard di'viation may be defined as the square root 
of the mean of the squares of the deviations from the mean of 
the distribution. If the distribution is normal, 34 13 per cent 
of all the cases are included within a distance of one standard 
deviation on each side of the mean, and, therefore, 68.27 or 
slightly more than two-thirds of the cases fall withm a range 
of plus or minus 1<7 from the mean. 

The formula for the standard deviation of a simple senes is 



The application of this formula and the 


computation of the standard dexuation are illustrated for the 
distribution in Table XXV. By addmg the measures and 
dividing by their number, 15, the mean is found to be 21.4. 
The deviation of each nu‘a.sure from the mean is then found 
and entered m the second column. In the thud column, headed 


’ H. L. Riels and others, Handbook of Mathemaiicd Staiiatict (Boston, 
Houghton Midlin Co., 1924), pp 29-31. 

* A number of other names are also applied to this measure, but none 
of them 18 used eufRciently often in educational practice to be worth re- 
membering. Among them are the root-meanr^quare daaatton, mean-tguan 
deviatum, and error of mean tquare. 
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TABLE XXV 

Comptjtation of Standard Deviation 
OP SniFLE Series Using Exact 
Mean 



d*, are the squares of the deviations. These squares are then 
summed, giving 559.60. This is divided by N, here 15, the 
result bemg 37.3067, which is equal to a*. Taking the square 
root of this, we find the standard deviation to be 6 1 1 If, then, 
the distribution were normal, slightly over two-thirds of the 
measures therem would be within 6.11 points of the mean, 
21.4, or between 15.29 and 27 51. As a matter of fact, only 
53.33 per cent of the measures fall within thesi* limits. If there 
were a larger number of cases in the senes it is probable that it 
would more nearly conform to normality, and, therefore, the 
per cent of cases within lir of the mean would be more nearly 
equal to 68.27. 

The computation may be made somewhat easier by em- 
ploying an assumed mean just as in determining the mean. To 
iUuetrate this the same senes has been given in Table XXVI 
and the standard deviation computed by using 20 as the as- 
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TABLE XXVI 

CoMPTJTATION OF STANDARD EhsVUTlON 
OP Simple Series Using Asbumeo 
Mean 



d 

tl’ 

30 

+ 10 

100 

29 

+ 9 

81 

28 

' + 8 

64 

28 

+ 8 

64 

26 

+ 6 

36 

24 

+ 4 

16 

23 

+ 3 

9 

22 

- 1 - 2 

4 

21 

+ 1 1 

1 

19 

- 1 ! 

1 

18 

- 2 i 

4 

16 

- 4 

16 

14 

- 6 

36 

14 

- 6 

36 

9 

-11 

121 


+51 

isl^ ■ 


-30 

1 .') [ - 1-21 

= 39 2667 


1 = 1 96 


14 

I a' - 37 3067 


1 

1 (7 = 611 ’ 


-r 


sumed mean. The d column m this case contains deviations 
from 20.) The plus and minus deviations are summed separately 
and their algebraic sum found just as in the determination of 
the mean. In this ca«> it is +21. This is dividini by N, 15, and 
the result, 1 4, is the correction, c. The third column contains 
the d*'8 as before and their sum, 589, is again divided by the 
number of cases, givmg 39 2667. This quantity is commonly 
termed S*. From this c^ which is 1 96, is subtracted, giving 
<r* = 37 3067, the same as was found in the previous computa- 
tion. Unless the mean happens to be a round number it is 
recommended that this method be employed. The formula 
for it may be expressed as follows: 
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As is true of the mean and most other measures, however, 
the standard deviation is usually found for a grouped frequency 
distribution rather than for a simple series. The formula for 
the computation of the standard deviation in a grouped fre- 
quency distnbution differs from that just given only in the 

/ V ffP 

— c*. The general 

method of computation is the same as that just illustrated, 
except that it is adapted to the grouped senes. It is similar 
to the computation of the mean for such senes except that an 
additional column is added This last column, headed fd}, is 
obtained by multiplying each entry in the fd column by the 
corresponding one in the d column * Thus the first entry, 48, 


TABLE XXVII 

CoMPtrTATiON or Standard Deviation of Frequenct 

DlhTUIBl’TION 


/ 

d 

f.i 

1 Jd^ 

75- 3 

+4 

+ 12 

4B 

70- 5 

•+■3 

+ 15 

45 

65- 6 

+2 

+ 12 

24 

60- 6 

+ 1 

+ 6 

6 

55- 6 

0 

+ 15 

0 

60- 4 

-1 

- 4 

4 

45- 2 

-2 

- 4 

8 

40- 2 

-3 

- 6 

18 

35- 3 

-4 

-12 

48 

30- 1 

-5 

- 5 

25 

26- 1 

-6 

- 6 

36 

20- 1 

-7 

- 7 

49 





N-40 


-44 

40| + 1 
c “ 025 

40|3n 
.S’» - 7 775 
c* - .000625 

<r* - 7 774375 
a “ 2.788 mt 
» - 5. 
a — 13.94 unite 


* The entnee in this column can also be obtained by squaring each one 
m the d colunrm and multiplying by the corresponding / entry, but the 
method given in the text above is slightly easier. 
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is the product of 4 and 12; the next, 45, that of 3 and 15; and 
so on. All of the entries are positive, since each is the product 
of two numbers with similar signs. This column is then summed, 
giving m this case 311,. This is divided by the number of cases, 
40,* which yields 7.775 as the value of S^. From it c*, here 
.000625, IB subtracted, leaving (r* = 7 774375 Taking the 
square root thereof, a is found to be 2.788. This, however, is 
in terms of class intervals, so to change it-to u^s it is multi- 
plied by t, here 5, giving a value of 13 94 units In practically 
all cases except the computation of coefficients and ratios of 
correlation, which will bi‘ taken up later, this last step shouki 
be carried out and <r expres.sed in terms of actual units 
The method of finding the standard deviation of a frequenter 
distribution, as well as most other computations based upon 
such a distribution, assumes that the measures m each interval 
are concentrated at the mid-point of that interval. This assump- 
tion introduces a slight error. Inasmuch as there are usually 
more measuri's on the side of the mid-point of each interval 
toward the average than there are on the other side, the effect 
of this error is to make the obtained standard deviation 
shghtly too great .\n approximate correction for this error 

may be made by subtracting ^ from the obtained value 


of (T^ before extracting the square root and multiplying by 
t Expressed as a formula in terms of interv’als, this is 


as follows O-eoiT 



1 

— • It will be evident from an ex- 


amination of this formula that the smaller the number of 
classes the greater the obtained value of sigma, that is, the 
greater the positive error in it In the example just given, the ap- 


phcation of this formula gives; 2 788^ ~ 2.773 


intervals instead of 2.788, thus indicating that the error in the 
uncorrected measure is small. Thorndike gives a table of 


^ For the standard deviation in terms of units instead of intervals the 
formula is ffoorr - |/o 


®'obt 


*' E L Thorndike, An IntrodueUon to the Theory of Mental and SoeuU 
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corrections to be subtracted from the obtained value of the 
standard deviation instead of from its square. These range 
from less than .001 step in case the distribution contains forty 
classes, to .04 step in case it contains only six. These correc- 
tions yield closer approximations to the correct standard durar 
tion than does the formula above It is, however, very rarely 
the practice in ordtnaiy work to correct for groupmg by either 
method. 

There is also another factor that causes the obtained value 
of the standard deviation to be slightly too large. This is the 
effect of variable or chance errors If there are available two 
series of measures of the same trait or charactenstic of the 
same individuals and the variable* emirs in one senes are not 
correlated with those in the other, it i.s fxissible to compute a 
standard deviation unaffected by such errors by the use of the 


formula c= 


in which i-i stands for the deviations 


of the measures in one senes from their mean and xi for those 
of the measures m the other In other words, the standard 
deviation is computed from the prixlucts of corresponding 
deviations from the mean instead of from the squares of the 
deviations m a single senes 

In case the coefficient of correlation or reliability between 
the two series of measures is known, the value of the standard 
deviation of true or perfectly ri'liable measures is given by the 
formula; Ctnie or (Too = Cobt Vr, in which r is the coefficient of 
reliability. 

If the standard deviations of each of two forms of a test are 
known, that for the two forms combined may be obtained by 
the formula 


O’! +1 


\/?^(c r i + <Ti) 



2r„ 

H-r„ 


MeaturemmU (New York, Teachers College, Columbia University, 1913), 
pp, 55-66 
*• See Chapter XI. 
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For n forms the general formula is as follows: 




Vrii(<ri + <Ti + ■ ■ ■ -f (T,) 



nru 

1 + (n - l)r„ 


If the standard deviations are all equal, so that the situation 
IS equivalent to repeating the ongmal test n times or malring 
it n times as long, (t„ = aiVn + ?i(n — l)rii In these for- 
mulae rji is again the coefficient of reliability. 

It IS often desirable to check the value of the standard 
deviation by assuming the mean in a different class, ordina- 


TAHLE XXVIII 

CosipcT-iTiox OP St\si-)\kd Deviation 
WITH All Devutionp Pomtive 


/ 


75- 3 

12 

70 

H 

O.V- t) 

10 

00 (i 

9 

5o- t) 

8 

50- t 

7 

4.5- 2 

6 

40- 2 

5 

3.5- 3 

4 

30- 1 

3 

25- 1 

2 

20- I 

1 

X - 40 



/<t 

/,/> 

36 

132 

55 

605 

60 

600 

54 

486 

48 

409 3% l| 

28 

196 

12 

72 

10 

50 

12 

48 

3 

9 

2 

4 

1 

1 

321 



a 





321 A 
40 ' 


13 94 


rily the one next to that in which it was taken at first, and 
then proceeding as before. Since it makes no difference in 
what class the mean is assumed insofar as the final result is 
concerned, the results from the two computations should agree 
exactly. 
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It has been suggested by Harris/* Rural/* and Ayres “ that 
the standard deviation be found by assuming the mean in the 
class immediately below the lowest class in the distribution. 
So domg eliminates all minus deviations, but requires the use 
of somewhat larger numbers. On the whole, it is probably a 
better method if computing machines are employed, other- 
wise not For the distribution previously employed this method 
is illustrated in Table XXVIII It will be noted that the entries 
in the d column begin with 1 for the lowest class and run up 
to 12, since that is the number of classi's The fd and /d* col- 
umns are obtained just as before, that is, the first is the product 
of the entries m the / and the d columns, and the latter of those 
in the d and/d columns. The last two columns are totaled and 
their sums employed in the following formula ** 



Substituting in this we have 



which, as before, gives a value of 13 94. 

Several more or less mechanical devices to aid in the compu- 
tation of the standard deviation have been suggested. Perhaps 
the best of these is described in an article by Croxton ” Others 


J. Arthur Hams, “The Arithmetic of the Product Moment Method 
of Calculating the Coefficient of Correlation,” American Naliiralut, Vol. 
44, November, 1910, pp 693-699 

'‘Beardsley Ruinl, “On the Computation of the Standard Deviation,” 
Psychological BuUeltn, Vol 13, Noveralier 15, 1916, pp 444-446. 

"Leonard P. Ayres, “Shorter Method for Computing the Coefficient 
of Correlation,” Journal of Educational Research, Vol. 1, March, 1920, 

pp. 216-221. 


'• Since c 


Zfd 

N’ 


this formula is equivalent to the formula given on 


page 126. 

” Fredenck E. Croxton, "An Apparatus to Assist in the Calculation 
of the Standard Deviation of a Grouped Frequency Distnbution,” Journal 
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have been suggested by Toops and Jenkins.** It does not 
appear to the writer that for most computers there is sufficient 
gain in such devices to warrant their use. 

If the deviations of the measures m a distribution are relar 
tively small compared with the mean so that the third powers 
of their ratios to the mean may be neglected, certain approxi* 
mate relations hold between the standard deviation and the 
mean, the geometric mean and the harmonic mean. These 
may be expressed as follows ' 


a 


VM* — G’*or = 


MH or = 



Thus if any two of these three averages are known, the approxi- 
mate standard devoation can bp determined from them. 

It has been suggested that in some circumstances the square 
of 'the standard deviation rather than the standard deviation 

tl 

itself may be uai'd to measure variability. When this is done 
the term variance should be apphed rather than mnabdUy, 
That IS to say, just as ff is employed as a measure of varia- 
bility so <r* IS usi'd as a measure of variance. Practically the 
only connection in which the square of the standard deviation 
has been eniployi'd in connection with educational data is in 
the interpretation of the coefficient of correlation, and refer- 
ence will be made to it in the discussion thereof. 

Although both in the previous portion of this section and 
in practically all other texts on educational statistics, N has 
been used as the denominator of the fraction from which the 
standard deviation is computed without regard to the number 
of cases, tins is not strictly accurate. If — 1 is used instead of 
N when the number of cases is small, perhaps less than thirty, 
the result is commonly a nearer approach to the true value of 
the standard deviation 

of the American Staiislical ,4s«orw/«m, Vol 20, December, 1925, pp. 532- 
536. 

*• Herbert A. Toops, “Two Devices for Aiding Calculation,” Journal 
of Experimental Psychology, Vol 9, February, 1926, pp 60-66. 

** Thomas N. Jenkins, “ Apimratus to Facilitate the Calculation of the 
Moments in a Distribution,” Journal of the American Statii^ical Auoeia- 
iton, \ol. 23, March, 1928, pp 58-60. 
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Median deviation. The median deviation (MdD) is merely 
the median of the deviations from the mean. From the definition 
of the median it follows that half of the measures in the distribu- 
tion are not farther than one median deviation from the mean 
and that the other half are that far or farther from it. 

It is possible to find the median di'viation by tabulating the 
deviations and determining their median Tlus method, how- 
ever, is practically never used Instead, the median deviation 
is regularly found by computing the standard deviation and 
multiplying it by 6745®* This relalumship holds for the normal 
frequency distribution and is commonly employed for distribu- 
tions of other shapes as well Unless a distribution is decidedly 
asymmetrical or skew, the error invoh'ed in usmg .6745 is not 
likely to be very great. 

The median deviation is often erroneously called the probable 
error. It is frequently abbreviated, therefore, by PE instead of 
by MdD. The term probable error should be reserved for another 
use which will be mentioned later The two quantities, however, 
are numencally equal and are found in the same way, hence the 
confusion of terms. 

In the case of a normal distribution the median deviation and 
the quartile deviation have the .same value and m the case of 
most other distnbutions the difference between their values is 
comparatively slight. The quartile deviation, however, is 
regularly associated with the median, whereas the median 
deviation is associated with the mean. There is also the differ- 
ence that the median deviation is a definite distance laid off on 
each side of the mean, whereas the quartile deviation is one- 
half of a distance which ordinarily has the median near, but 
only m a symmetrical distribution exactly at, its center. 

Comparison of measures of variability. In order to illustrate 
the comparative sizes of the different measures of vanability, 
Figures 32 and 33 have been included. The first represents a 
normal frequency curve upon which the quartile deviation, the 
10- 90 percentile range, the mean deviation, the standard 
deviation, and the median deviation have been shown. It is 
“ More exactly, MdD - 674489749<r 



MEASURES OF VARIABILITY 


133 


evident that the 10- 90 percentile range includes a larger number 
of cases than any of the others, that is, 80 per cent of all. Next 
in size is the standard deviation, which mcludes about 68.27 per 
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FIG 32 NORMAL CURVE SHOWING MEASURES OF VARIABILITY 

cent W’hen laid off in both directions from the mean; next the 
mean deviation, which includes about 57 5 per cent , and, finally, 


f 



0 2 4 6 8 10 12 14 

Score 


FIG. 33. SKEW CURVE SHOWING ME.ASURES OF V.ARIABIUTY 

Qi =« 6 56 and O' = 6 6.1. so ihi' point halfway liotwcyn tbpm la S 25 rather 
than S 52, tho nictliaii 0 i-' laid off from thp latter, however. 

the quartile and median deviations, both of which mclude 
50 per cent. 

Figure 33 shows the same measures for a skew or asymmetrical 
curve. It will be noted that on this the median and quartile 
deviations are not exactly the same. Furthennore, since the 
median is not at the halfway point between the first and third 
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quartiles, the quartile deviation, when laid ofiF on both aides of 
the median, does not exactly reach the quartile points. 

In the sections in this chapter dealing with the various meas- 
ures it has been stated that each when laid off from the proper 
average includes a certain per cent of the cases in a normal 
distribution Not only are the.se per cents known for a distance 
of one deviation, whatever it may be, from the average, but also 
for any other distance. Table XXIX gives the per cents of cases 

TABLE XXIX 

P’bb Cents of Ca.ses in v Normvl Distribotion iNCLirDED 

WITHIN THE GiVE.N FROM THE AvERAOE 


N 

<3 


\ri) 

1 

90 

1 

50 (X) 

50 00 

:>7 5) 

1 08 27 

98 96 

2 

82 27 

82 27 

H8 91 

95 45 

100 00- 

3 

95 70 

95 70 

98 33 

99 73 

100 00- 

4 

99 30 

99 30 j 

99 80 j 

99 99 

100 00- 

5 

99 93 

99 93 

9‘» 99 

100 00- 

KM) 00- 


included by distances equal to one, two, three, four, and five of 
each of the five measures of variability on both sides of the 
average Thus a distance of 1^? in both directions includes 
50 per cent of the cases, a distance of 2Q includes 82 27 per cent 
of the cases, one of 3Q includes 95 70 per cent of them, and so 
on. If one wishes to secure the per cents on only one side of the 
average, the entnes should be divided by two. For example, 
the table shows that one quartile deviation on both sides of the 
average mcludes 50 per cent of all the cases, therefore the same 
distance on one side includes 25 per cent of the total number of 
cases. 

To illustrate graphically the meaning of this table. Figure 34 is 
given. It shows a normal curve divided by ordinates erected at 
distances of one, two, three, and four median deviations from 
the mean. In companng this figure with the second column of 
the table it should be remembered that the area m a graphic 

** The per cents of cases included by certain fractional values of the 
standard and median deviations, which are the measures of this sort most 
commonly employed, may be found m Appendix B. 



MEASURES OP VARIABILITY 


135 


representation of a distribution corresponds to the number of 
cases. Thus in the figure the area mcluded within 1 MdD of the 
mean is 50 per cent of the total area and corresponds to 60 per 
cent of the cases, that mcluded withm 2 MdD is 82.27 per cent 
of the area ; and so on. 

In the discussion of the normal curve in Chapter IV it was 
stated that theoretically it never touches the base line, hence its 



-5-4 -3-2 -1 0 +1 +2 +3 +4 +5 

Median Devlationj 

FIG 34 NORMAL CGRVE 

Normal curve with ordmatos at distance*) of one, two, three, four, and 
inwlian deviations from the mean 

honzontal e.xtension is unlimited. In any actual distribution, 
however, there is a definite limit beyond which there are no 
cases. If the distribution approximates nonnality, its limits 
tend to depend upon tlie number of cases included Table XXX 


TABLE XXX 


ApPBOXIMtTE DlSTtNCE', CoVEKED BT Dl'^TBIBtmONS 
CoNTAlMNf. TIIE tilVEN Nl'MBER.*. OF CaSBS 


A 

Q 

\f.U) 

MD 

CT 

10 

10 

.5 8 

.5 .S 

4 9 

39 

1 5 

25 

68 

1 (> h 

57 

46 

1 1.8 

60 

7 6 

1 7 6] 

64 

5 1 

20 

too 

83 

83 1 

70 

5 6 

2.2 

200 

89 

89 

76 1 

60 

2.4 

500 

97 

97 

8.2 1 

66 

2.6 

1000 

10 3 

10 3 

8.7 

7 0 

2.7 


gives the approximate distances, in terms of the various meas- 
ures of variability from the average, which one may expect to 
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find between the limits, that is, the highest and lowest cases, of 
distnbutions having, respectively, 10, 25, 50, 100, 200, 500, and 
1000 cases. Thus a series contaming ten cases usually extends 
a distance of about 5.8Q or MdD, 4 9MD, 3.9(r, or 1.5Dio-(», 
and so on for those of larger numbers. The distance from the 
average to the extreme case m either direction is half of the 
given distance in any case It will be seen that the larger the 
number of cases in a distribiilion the further it usually extends. 

The use of measures of variabihty. The range may be used 
with any measure of central timdimcy, i.s easily computed and 
readily comprehensible, but ha-: .sexerai very significant dis- 
advantages. It IS subject to such large fluctuations that it is 
not at all stable. Smcc it depends entirely upon the two extreme 
measures, a change in eithc'r one of these may affect it very 
decidedly. Also it takes no account of the general form of the 
distribution It must bc' regtirded, therefore, as usually the 
least valuable of the measures of xanabihty and should bo used 
only as a rough mspcctiona! niea.'-ure or to supplement others. 

The quartile deviation, which is used with the median, 
possesses more merit than the range, and yet is more or less a 
makeshift measure. A point in its favor is that it is fairly easily 
determined and understood It is, however, not a real deviation 
from any average. If the distribution is very nearly normal, 
Q* — Md is so nearly the same as Md — Qi that no appreciable 
error is mvolved m using Q as a distance from the median. 
Except in such cases it should be regardwl as a measure to be 
used rather rarely. 

The 10- 90 percentile range shares the weakness of the quartile 
deviation in that it is not a distance from any average It is 
much more reliable than Q, however Sinc(> little use has been 
made of it so far, one will find few comparable data if it is em- 
ployed. 

The mean deviation may be found around either the mean or 
the median, is not unduly difficult to compute by the short 
method, and is easily undi^rstood. However it does not seem to 
be particularly useful and is not very commonly used. Probably 
oaoe reason for this is that, if laid off on both sides of the mean, it 
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includes about 57.5 per cent of the measures, which is rather 
an odd number. 

The standard deviation, which is associated with the mean, 
is a measure of vanabihty that possesses many advantages and is 
often used. Being the distance from the mean to the point of 
inflection,®® it is a function of the normal probability curve and 
therefore is mathematically suitable for use as a unit. It is 
rigidly defined numerically and is based upon all the measures. 
It IS less affected by errors of samphng than any of the others 
mentioned, and therc'fore is more reliable. The method of 
deriving it provides a simple way of eliminating signs, thus 
getting a measure of vanabihty that vanes with the actual 
vanabihty of the distnbution It is not very difficult to calculate, 
although more so than any of those previously mentioned. Not 
infrequently the coefficient or ratios of correlation or the regres- 
sion coefficients are to bo calculated later, and the standard 
deviation is a step in doing so. It is true of this measure, as of 
none of the others except the median deviation, that the stand- 
ard deviation of a given distribution may be expressed in terms 
of the standard di'viations of the component parts of the dis- 
tribution. Thus if (Ti, 0-2, etc., are the standard denations of 
several distributions, Ni, Nz, etc., the numbers of cases, and 
di, dj, etc., the differences between the means and that of the 
senes formed by combining the several distributions; then 


'combined senes 


|/- 






Perhaps its greatest disadvantage is that it gives more weight 
to the extreme measures than do the others. In some mstances 
this 18 desirable , in others it is not. 

The median deviation is also usually found about the mean. 
Since it is a given fraction of the standard deviation, it naturally 
possesses most of its qualities. Its calculation involves only 

“ The point of inflection is that point at which the slant of the nomml 
curve forms an angle of exactly forty-five degrees with the base line. In- 
ude that point, that is nearer the center of the curve, the angle formed 
with the base line is greater than forty-five degrees, and, outside of it, it 
is leu. 
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slightly more labor than that of the standard deviation, and its 
meaning is probably more easily understood. It and the stand* 
ard deviation, therefore, are the two measures of variability 
to be used m most cases. 

Not only in the case of the standard and the median deviations 
is there a definite numerical relationship existing if the frequency 
distribution is normal, but the same is true with respect to the 
mean deviation and the 10-90 percentile range also. These 
relationships may be stated as follows 

<r = 1.2533MZ) or 1 4826il/dZ) or .3902Dio-90 

MD = .7979£r or 1 1829A/f/£) or .3ll3D,o-flo 

MdD = .6745(r or 8453MZ) or .2632Z>,o-90 

Z)io-flo = 2.5631(7 or3 21243fD or 3 8001il/dZ) 

Since the quartile deviation of a normal distribution is the same 
as the median deviation, it may Ik' substituted for it in these 
equations. In the case of an a.syrametncal distnbution these 
relationships are most seriously disturbed for the quartile 
deviation and the 10- 90 {X'rcentile range, and least for the 
standard and median deviations 

The mean difference method. The mean difference method 
of measunng the variability of a series of measures differs from 
the various measures already given in this chapter m that 
instead of measunng how much the measures in a distnbution 
scatter about some average, it measures how much they differ 
from one another without regard to any average. The method is 
not commonly employed but nevertheless seems to deserve a 
brief explanation. 

The method consists of finding the mean of the differences 
between e.ach measure m a senes and each other measure 
therein. For example, suppose that a senes of twelve measures, 
1, 2, 2, 3, 5, 8, 9, 10, 11, 12, 14, and 15, is being dealt with. One 
may find the mean difference by determining the differences 
between the first measure, 1, and each of the others; between 
the second measure, 2, and each of the others, and so on, sum- 
ming them, and dividing by the number of differences to get the 
mean. For any considerable number of cases, however, this is a 
decidedly laborious method. Instead of using it, one may 
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employ a formula that gives the same result with much less 
work. Procedure according to this formula is illustrated in 
Table XXXI. 

TABLE XXXI 

Computation of the Mean Difference 


Part A 

When the Nimtier «/ Canes Is Even 


Part B 

When the X umber of Cases Is Odd 



d 

! m 

md 


d 

m 

md 

1 

1,5 

14 

11 

1.54 

32 

51 

' 19 


190 

2 

14 

12 

9 

108 

33 

47 

14 

8 

112 

2 

12 

10 

7 

70 

35 

45 

10 

6 

60 

3 

11 

8 

.5 

40 

38 

42 

4 

4 

16 

6 

10 

I 5 

3 

15 

39 

41 

2 

2 

4 

8 

9 

1 

1 

1 

j 

40 

1 

1 


382 





388 







Mean cliff 


- 5 88 
1211 ■ 


Mean diff 


2 382 
H 10 


6 95 


Since there is a slight I'anation m the procedure when the num- 
ber of cases is odd from that when it is even, the table contains 
two parts, A illustrating the computation of the mean difference 
when the number is even, and B, when it is odd. 

The first two columns in A contain the measures arranged m 
order, with the smallest at the top of the first column and the 
largest at the top of the second colunm. In the third column, 
headed d, are the diffen'nces betw'een the corresponding meas- 
ures m the two columns The fourth column, headed m, contams 
a senes of multipliers of which the first is always one less than 
the total number of cases in the senes and each of the others 
two less than the one immediately above it Another way of 
statmg the same thing is that the multiplier at the bottom of the 
column IS one and each of the others two larger than the one 
below it. In this case, since the number of cases is 12, the first 
multiplier is 11, the next. 9, and so on down to 1. The last column 
in A, headed md, contains the products of the corresponding 
entries in the last two columns. This column is then summed, 
the result multiplied by 2, and divided by the product of the 
number of cases times one less than the number of cases. Thus, 
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for the data given the sum of the last column is 388, which is 
multiplied by 2 and the product divided by 12, the number of 
cases, times 11, which is one less than 12, giving 5.88 as the mean 
difference. The formula may be stated thus: 

Mean diff . = 

The procedure for an odd number of cases shown m B is the 
same except that the middle measure in order of size is not 
placed m either one of the two columns but is either omitted or, 
as is shown in the table, entered between the two columns. The 
djSerences are taken as before and the multipliers found 8im« 
ilarly, the largest bemg one less than the number of cases. In 
this case the smallest multiplier is 2 and the others therefore 
increase by intervals of 2 up to 10 The same formula is then 
applied, giving in this case 2 tunes 382 divided by 11 tunes 10, 
which gives 6.95. 

The coefficient of variability. The coefficient of variability 
or variation is an absolute number that measures the relative 
and not the absolute variability of the measures in a distribution. 
It may be known, for example, that the standard deviation of 
one distnbution is 20 and that of another 2, but unless these 
figures are mterpreted in comparison with the sizes of the meas- 
ures themselves, that is, with the opportunity for variation, they 
are in many situations not very significant If the average in 
the first case were 100 and that in the second 10, the two stand- 
ard deviations just given would, from one standpoint at least, 
represent equal variability. Therefore it is only by the use of 
such a measure as the coefficient of variability that distributions 
expressed in different units or having averages that are mate- 
rially different can be satisfactorily compared with regard to 
their variabihty. 

The generally employed formula for the coefficient of va- 
riabihty is C of V, or just V, = 100^.*’ Apply^ing this to tlie 

“The only reason for the introduction of the multiplier lOO into the 
formula is to yield a result that is in part at least a whole number rather 
than a fraction. 
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distribution given on page 72 and elsewhere, for which the mean 
and standard deviation have already been found, 


V = 


100 


13.94 
57 625 


24.19 


The coefficient of vanability is not a thoroughly reliable and 
accurate measure by means of which to compare two distribu- 
tions. This 18 due to the fact that the zero pomt of a scale may 
be a false zero point. If this is true the amount by which it is in 
error enters into the denommator of the fraction m the formula 
and thus causes the value of the coefficient of variability to be 
somewhat misleading and not strictly comparable with the 
coefficient of variability of another distribution, unless the aero 
points of both scales are proportionately in error However, no 
better measure for comparing the vanabilities of different 
distributions has been proposed, so that the coefficient of 
vanability still continues in use 
It should perhaps be mentioned that several other methods 
of determinmg relative measures of vanability have been sug- 
gested. Thorndike has proposed one that has received some use, 
but a cntical examination of it mdicates that it is not valid 
smce a mere difference in the unit u.sed changes the result 
obtained For example, in dealing with height it makes a dif- 
ference whether hgures are given in feet or inches, in dealing with 
money whether in dollars or cents, and so on. In economic and 


industrial statistics the formula 


Q 

Md 


IS sometimes employed, but 


it has been used rarelj if ever in educational work. Boynton 
has discussed it, along \Mth the one recommended above and a 
third one, and reached the conclusion that the three scarcely 
measure the same thing and that no one of them is satisfactory. 


E-XERCISBa 

1. Compute the range bv finding probable position of the two ex- 
treme measures, the quartile deviation, the 10-90 percentile range, 
the mean deviatibn around both the mean and the mixlian, the standard 

** Paul L. Boynton, “The Coefficient of Variation as a Tool in Educa- 
tional Practice,” Peabody Journal of Education, Vol 11, March, 1934, 
pp. 216-224 
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deviation, the median deviation, and the coefficient of variability of 
each of the following distributions. 


A 

B 

C 

D 

E 


/ 

/ 

/ 

/ 


/ 

lOO- 1 

85- 4 

28- 3 

4500- 1 

180- 

2 

90- 2 

80- 3 

26- 1 

4000- 0 

160- 

7 

80- 5 

75- 5 

24- 7 

3.')IX)- 2 

140- 

9 

70- 9 

70- 8 

22- 11 

3(K)0- 4 

120- 

15 

60- 13 

65- 7 

20- 14 

2.500- 6 

100- 

31 

50- 18 

60- 9 

18- 18 

2(KX)- 11 

80- 18 

40- 22 

55- 6 

16- 16 

1.500- 24 

60- 

17 

30- 18 

50- 4 

14- 21 

1000- 16 

40- 

12 

20- 16 

45- 2 

12- 19 

= 64 

20- 

6 

10- 8 

40- 0 

10- 13 


0- 

1 

0- 3 

N = 115 

35- 1 

iV = 49 

8- 17 

6- 10 

4- 8 

2- 4 

0- 2 

N = 164 


N = 118 


2. Compute the mean difference for each of the following sets of data: 

A. 27, 21, 35, 19, 24, 2H. 33, 2.'), 2(5, 30, 34 , 23, 19, 22, 28. 

B. 94, 87, 88, 99, 82, 85, 91, 92, 83, 90, 95, 93. 
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AN INTRODUCTION TO CORRELATION 

The definition of correlation. {One of the most common needs 
in dealing with educational data is to determine the relationship 
between two or more senes of measures of the same individual 
cases For example, one may desire to know the relationship or 
agreement bt'tween pupils’ school marks m anthmetic and in 
readmg, between intelligence tf*st scores and average school 
marks, between the amounts of training possessed by teachers 
and the salaries received by them, between a measure of pupils' 
physical condition and their success in school, and so on. Rela- 
tionship of this sort is commonly known as correlation, a term 
derived from co-rclation. Usually only two variables or senes of 
measures are concerned m a particular correlation, although 
there may be more This chapter, and also the next six chapters, 
will be limited to the consideration of cases m which there are 
only two senes. 

The method of comdation is often called a study of paired 
facts. This definition emphasizes the point that measures of 
correlation cannot bi‘ computed unless there are available two 
or more measures for each of a number of mdividuals. It is 
impossible, therefore, to compute correlat ion between the school 
marks of one group of children and those of another, or between 
intelligence test scores of pupils in one school and those of pupils 
in another^ 

For further discussion of the general meaning of correlation 
and the mathematical idea of function with which it is closely 
connected the reader is referred to Ezekiel.' His Chapter III 
is particularly concerned with the general meaning of correla- 
tion, but Ezekiel’s whole book is devoted to correlation and 

' Mordecai Ezekiel, Methods of Corrdatwn Anedysu (New York, John 
Wiley & Sons, 1930), 427 pp 
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is by far the most thorough and significant discussion of corre- 
lation with which the writer is acquainted. 

Positive and negative correlation. The common methods of 
measuring correlation lead to the computation of single nu- 
merical expressions that summarize the amount or degree of 
correlation between two senes of scores. Most of s uch ei^res- 
sions may be either positive or negative,® ranging from +1.00 
t hrough zero down to —100 in possible value . Others are 
always positive, ranging from zero up to 1.00, and thus do not 
distinguish between positive and negative correlation. A few 
have other limits. 

P ositiv e correlation, as its name implies, denotes correlation 
i n which t he two vanables tend to vary t oge ther, that i s, as 
one incr^ses the other tends to increase, and as om 
100 95 decreases the other tends to decrease. Perfect posi- 
W ^ correlation is illustrated by the two columns of 
85 80 figures at the left It will be seen that there is a uni- 
80 75 form relationship between each pair of measures, 
75 70 each entry in the si'cond column bemg just five less 
70 65 ^{mjj tjjg corresponding entry in the first column. 
^ gg This relationship may be an increment, that is, a 
55 50 uniform amount added or subtracted, as just shown, 
or it may be a ratio The latter is illustrated by the 
second set of columns. The entries in the first column are the 
same as m the previous example, but each entry in the second 
100 80 is four-fifths of the corresponding entry m the first, 
95 76 instead of five less than it. The correlation in this 
66 72 case also is perfect and positive. The same is true for 
^ any two series of numbers in which each measure in 
75 60 series may lx* obtained from the corresponding 
70 56 one in the other by addmg or subtracting the same 
65 52 amount, multiplying or dividing by the same factor, 
60 48 or a combination of the two processes, for the whole 
^ senes. 

Perfect n^ative correlation is just the reverse of the condi- 

* Positive correlation is sometimes called direct correlatioD and nega- 
tive correlation inverse. 
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tion described. It may be illustrated by the columns at the 
right. These are the same as in the first example for 
perfect positive correlation except that the entries 
in the second column are reversed. Therefore the qq ^ 
smallest measure in the second column, 50, is paired 35 35 
with the largest m the first column, which is 100; 80 70 
the second smallest, 55, with the second largest, 95; 75 75 
and so on down regularly until the largest m the second ^9 
column, 95, is paired with the smalle.st in the fir8t,^t ^ ^ 
55. There would also be perfect negative correlation 55 gg 
if the entnes in the second column in the seconc^ex- 
ample illustrating perfect positive correlation were reversed 
and paired with those m the firat. 

It is, however, relatively infr equent that either perfect po si- 
tive oF^rfect negative correla ti on is fo und to ex is t. If t here 
is a rather high degr ee of agr eement between the two 
^ffes of measures, it is more likely that . they Wlfl ^ 
tend to run somewhat as shown at thexight thanj^ ^ 02 
shown in any of the prenous ex^anaples There is a 35 gg 
strong tendency for each pair of scores to be of about 80 81 


the same size, but their relationship to each other is 
not absolutely uniform The tendency is strong 
enough, however, that when the correlation is com- 
puted it IS found to be fairly close to -j-l-OO 


75 74 
70 76 
65 70 
60 63 
55 59 


^ A situation in which there is practically no corre- 
lation or agreement between the measures is shown by the 


next example In this there is no tendency for the highest 


scores in the second column to be associated with 
either the highest or lowest m the first. The lowest ^ 
in the second column, 62, is paired with the highest qq 
in the first, the highest in the second, %, is piaired 35 35 


with the next to the highest in the first, and so on. 80 79 


In such a case as this t he correlation is near zero and 75 69 
indica tes that pract ically no relationship e.xist8^be- 
tweehT the two senes. ^ ^ 

Graphic representation of correlation. The correla- gg yg 
tion existing between two series of variables may also 
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be shown by plotting or graphing as well as by computing numer- 
ical measures. Although doing so gives a good idea of the sit- 
uation to one who is familiar with such graphs, it does not 
permit ready comparison of the correlation in one case with 
that in others, nor can the result be conveniently summarized. 
It is, therefore, almost universal practice to compute a nu- 
merical measure either alone or in addition to a graphic repre- 



FIG 36 GRAPHIC REPRESEVTATION OF CORRELATION 

Gnphs A &nd B represent perfect positive correlation. C perfect negative 
oorrelatiOD, D high but not perfect positive correlation, and E very low cor- 
relation. 

sentation of the data. The reader should, however, be familiar 
with the graphic representation of correlation both as an aid 
to understandmg the significance of the correlation in general 
and as makmg clearer the amount and nature of the correla- 
tion in particular cases. With this in view. Figure 35 has been 
prepared. It contains a set of five graphs that illustrate the 
correlation between the five pairs of columns already cited as 
examples in this section. These graphs, as is usual, are oon- 
structed according to the two-axis system previously explained 
in Chapter III. The first column in each case is considered as 
representing the X-variable, hence is laid off horizontally, and 
the second column as representing the Y- or vertical variable. 
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Thus in Graph A, the upper-right-hand dot directly above 100 
on the base line or X-axis, and directly to the right of 96 on 
the vertical, or F-axis, represents the first pair of measures in 
the first example given, that is, 100 and 95. The other pairs 
are represented in similar fashion. 

It will be seen that m Graphs A and B a straight line slanting 
upward to the nght may be drawn through the dots representing 
the pairs of measures. Such a Ime represents perfect positive 
correlation. In Graph C also the dots be upon a straight line, 
but it slants upward to the left. This type of bne represents 
jjerfect negative correlation. The dots in Graph D do not fall 
upon a straight line, but such a line slanting upward to the 
right may b(> drawn so that none of them is far from it. This 
indicates that there is a high but not pi'rfect positive correla- 
tion betiK'en the two scenes In Graph E the dots are so scat- 
tered that no straight line can be drawn through them m such 
a way that they w ill approach it much if any more nearly than 
any other straight lino, especially a horizontal or vertical one. 
This indicates that there is no or practically no correlation 
between the two senes of measures 

Rectilinear and curvilinear correlation. In what has just 
been said about correlation it has lx.*t'n assumed that the rela- 
tionship tK'tween the measures is rectilinear, often abbreviated 
to linear, that is, is best represented by a straight line. This 
is the type of relationship with w'hich the most common meas- 
ures of correlation deal However curvilinear, sometimes called 
novrlinear, correlation may exist. For an example of this, the 
two series given at the right may be used It will be 
seen that ehere is a dctinite and unvarying relation- ® 
ship between these two, but it is such that one series ^ ® 

cannot be obtamed from the other by adding or sub- 35 g 

tracting the same amount, by multiplying or dividing 25 5 

by the same factor, or by a combination of these 16 4 

processes. Instead, each entry m the second column ^ 3 

is the square root of the com^sponding entrj' in the ^ ^ 

first. The relationship, therefore, is positive and per- q 'q 

feet, but would not be revealed as perfect by a measure 
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that took account of straight-line relationship alone. This may 
perhaps be made clearer by plotting the data just given. Figure 
36 represents them. It will be seen that a smooth curve can be 
drawn through the dots representing the pairs of measures, a 
fact which indicates that there is a perfect relationship of some 
sort. In this case it is given by the second-degree equation,* 
X = F*. Such an equation can never be satisfactorily repre- 
sented by a straight Ime. 

It is possible though unusual to have perfect or high curvi- 
linear relationship between two senes of vanables, even though 

6 - • 

3 ■ • 

• ■ • 

• • 

0 «'■' » -i > 1 " I — j — I < ■ f . - 1 I I < 

0 10 20 30 40 SO 60 70 80 

FIG. 36 GRAPHIC REPRESKNT-KTION OF PERFECT POSITIVE 
CURVILINEAR ULLATIONSHIP 

The dote herein represent mtcicrii! of the equation A = F* up to 

> = 

the rectilinear relationship is zi'ro or very low This may be 
illustrated by Figure 37, which represents graphically the 
pairs of measures shown m the columns at the left. 
As is shown by the figure, these points arc all approxi- 
mately upon a scnucircle, or, in other words, there is 
practically perfect curvilinear relationship between 
the two senes No .straight line can be drawn, how- 
ever, to which the pf^ints approach closely enough to 
indicate that any rectilinear correlation exists. 

The interpretation of measures of correlation. Al- 
though the mterpretation of measures of correlation 
will be considered at some length later, it seems well 
to insert here a general statement concerning one phase thereof. 

* A second-degree equation is one in which one or more terms are raised 

the second power, that is, squared, and none to any higher power. 


0.00 0 
2.85 1 

3.75 2 

4.20 3 

4.40 4 

4.40 5 

4 20 6 

3.75 7 

2.85 8 

0.00 9 
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This is that a numerical index or measure of correlation may 
ordinarily be interpreted in one or the other of two ways. First, 
if the data used are accurate this index shows the actual 
degree of relationship existing between the cases Ujxin which 
the measure is based. The second is that, since the cases in- 
cluded are frequently considered as a sampling of the whole 
number of similar cases in existence, the numerical index ob- 


5 

• • 

* 

3 ■ ' • • 

2 ■ 
r- 

O-P 1 — ( ■! ) I I I I » 

0123456789 

FIG. 37 GRAPHIC REPRESENTATION OF HIGH CURVILINEAR 
BUT LOW RECTILINEAR CORRELATION 

tamed may be taken as measuring th(> correlation of the two 
traits or qualities for all cases similar to those for which data 
were obtained In this sense the index obtained cannot be 
said to be the true correlation, but only its most probable 
value. 

There is also another basis upon which twofold interpreta- 
tion IS possible. This has to do with whether a measure of cor- 
relation IS being found in the attempt to determme if there is 
any real relationship Ix^tween the two senes of measures con- 
cerned, or whether it has to do with the question of how close 
the relationship is. A measure of correlation may have con- 
siderable significance in the first connection and yet mdicate 
that the degree of relationship is so small to be of httle if any 
practical value. 


E.xercises 

1. Inspect the following senes of correlated measures and determine 
whether each represents fierfect jxjsitive, jierfect negative, high but not 
perfect positive, high but not ix*rfcct negative, or low, correlation. ^ 
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A 

B 

C 

D 

E 

F 


G 

H 

97 

85 

28 

44 

16 

38 

17 

65 

66 

4 

90 

1 

72 

31 

65 

16 

92 

80 

25 

38 

14 

34 

16 

68 

63 

6 

80 

3 

66 

28 

58 

24 

87 

80 

22 

39 

12 

30 

14 

71 

60 

8 

70 

6 

48 

19 

56 

12 

82 

75 

19 

42 

10 

26 

13 

74 

57 

10 

60 

10 

44 

17 

53 

19 

77 

75 

16 

40 

8 

22 

11 

77 

51 

14 

50 

15 

42 

16 

51 

14 

72 

70 

13 

43 

6 

18 

10 

80 

42 

20 

40 

21 

28 

9 

48 

23 

67 

65 

10 

37 

4 

14 

8 

83 

36 

24 

30 

28 

26 

8 

47 

13 

62 

65 

7 

45 

2 

10 

7 

86 

33 

26 

20 

36 

22 

6 

44 

20 

57 

60 

4 

41 

0 

6 

5 

89 

30 

28 

10 

45 

18 

4 

41 

17 

52 

55 





4 

92 

27 

30 

0 

55 

16 

3 
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THE COMPUTATION OF THE COEFFICIENT 
OF CORRELATION 

Definition of the coefficient of correlation. Although the term 
coefficient of correlation may be applied m a general way to any 
of th e vanous indices of correlation, it is regularly limited to_a 
particular measure of this sort This is th e measure ob tained 
by what is called the prod uct-moment ' method and abbre- 
viate by J. The coefficie n t of correlati on is a measure^pf 
Btraight.-line correlation which ranges in value from —1.00 
through zero to + 1 00. Therefore it measures correlation vary- 
in^rom perfect negative through none at all to perfect positive. 

The ordinary method of computation for ungrouped series. 
For small numbers of cases, perhaps thirty or forty pairs of 
measures, it is probably liest to compute the coefficient of corre- 
lation from the simple senes of ungroupe*d scores. The method 
of doing this makes use of exactly the same steps as are em- 
ployed m computing the standard deviation from ungrouped 
scores with the addition of certain others The simplest form 
of the formula use‘d is 

Zry 

Zxy N 2 

r = or 

NOjffy OtOy 

In this formula x is used to refer to the de\uation of a measure 
m one series from the me.an of tliat senes, and y, to the devia- 
tion of a measure in the si’cond series from its mean. The prod- 
uct of X and y for each pair of measures is found, and the sum 

* The product-moment coefficient of correlation is often caUed the Pear- 
soman method or coeJficient liecause of the prominence of Karl Pearson 
in connection with its use and application He did not, however, devise it. 

’ The numerator in this form of the formula, that is, -rr-, is sometimee 
denominated by the letter p. 
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(rf these products, which is denominated 'S,xy, is obtained. 
This sum is then divided by the number of cases and by the 
standard deviations of the two series of measures. The result 
is the coefficient of correlation. The effect of this formula is to 
compare the deviations of all the smgle pairs of measures with 
the general dispersions of the two whole distributions. Smce 
the greatest possible average product of x and y cannot be 
greater than the value of r cannot exceed =*=1.00. 

The use of the formula given in the preceding paragraph 
mvolves the determination of deviations from the mean. In 
practice, however, it is almost always easier to take an assumed 
mean just as was done m the cast' of the standard deviation, 
and later to correct for the difference between it and the true 
mean. So doing reduces th(> amount of arithmetical calculation 
needed in most cases, and thus les.sens both the tune n^quired 
and the possibility of error If it happims that the true mean 
is a round number, it is well to use it lather than the assumed 
mean and thus avoid the necessity for making the corrections, 
but this will not frequently be the case I'he modified formula 
for use with the assumed mean is as follows* 



(7 fO" y 

It will be seen that it differs from that already given only m 
Bubtractmg the product of the two corrections from the term 

in the numerator. 

N 

The application of the formula just given is illustrated by 
Table XXXII. The first column in this table, headed X, repre- 
sents the scores of twenty pupils on an intelligence test, and 
the second column, headed Y, the percentile .school marks of 
the same pupils. The first column has been arranged in order 
of the size of scores. This is not necessary, but facilitates compu- 
tation Following these columns are two headed x and y, which 
contain the deviations from the assumed means, 90 and 80, 
respectively, of the two columns. The plus and minus entnes 
in each of these columns are summed separately, and their 



THE COEFFICIENT OF CORRELATION 


153 


TABLE XXXII 

Computation of the Coefficient of Correlation of Unoboitfed 
Series with Assumed Means 


X 

D 

X 

* 

Jit 

I* 

11’ 

*!1 

125 

96 

+ 

35 

+ 16 

1225 

256 

+ 

560 

119 

93 

+ 

29 

+ 13 

841 

169 

+ 

377 

118 

97 

+ 

28 

+ 17 

784 

289 

+ 

476 

111 

84 

+ 

21 

+ 4 

441 

16 

+ 

84 

106 

89 

+ 

16 

+ 9 

2.56 

81 

+ 

144 

100 

79 

+ 

10 

- 1 

100 

1 

— 

10 

98 

88 

+ 

8 

+ 8 

64 

64 

+ 

64 

97 

86 

+ 

7 

+ 6 

49 

36 

+ 

42 

94 

84 

+ 

4 

+ 4 

16 

16 

+ 

16 

94 

78 

+ 

4 

- 2 

16 

4 

— 

8 

92 

76 

+ 

2 

- 4 

4 

16 

— 

8 

89 

83 

— 

1 

+ 3 

1 

9 

— 

3 

88 

83 

— 

2 

+ 3 

4 

9 

— 

6 

84 

7.') 

- 

6 

- 5 

36 

25 

+ 

30 

82 

80 

_ 

8 

0 

64 



0 

81 

72 

— 

9 

- 8 

81 

64 

+ 

72 

77 

73 

— 

13 

- 7 

169 

49 

+ 

91 

75 

66 

- 

15 

-11 

225 

196 

+ 

210 

74 

70 

— 

16 

-10 

256 

100 

+ 

160 

72 

62 

- 

18 

-18 

324 

324 

+ 

324 



+ 164 

+83 

20|'4956 

20jl724 

+2650 




88 

-69 

S’ = 247 80 

ri = 86 20 

— 

35 




20j +14 

cl = 14 44 

cl = 49 

20| +2615 



Cx - 

+3 8 

fx = + 7 

ffi = 233 36 

= 85 71 







Ox = 15 28 

= 9 26 

N 



130 Tf) - 38 X 7 128 09 

15 28 X 9 26 ” 141 49 ” 


* Tbe «it8um«d me&n of th« X cofumn ts 90 
t The aMumed meaD of the V «x>Iunin is 80 

algebraic sums determined These are +76 for the x column 
and +14 for the y one. They are divided by 20, the number 
of cases, giving Cx = +3 8andc„ = +.7. The next two columns, 
headed z* and y*, contain the squares of the entries in the two 
previous columns. Each column is summed, divided by 20, 
the corresponding c* subtracted from the quotient, and the 
square root of the remainder taken, thus giving for the standard 
deviations, a* = 15.28 and cr, = 9.26. 
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So far the work has been exactly similar to that given on 
page 126 for the computation of the standard deviation, except 
that two series instead of one have been dealt with. The column 
at the right, headed xy, involves a new step. It contains the 
products of the pairs of entries m the two d columns. Its alge- 
braic sum is found, in this case +2615, and this sum divided 

by the sum of cases, 20, to give which here equals 130.75. 


All that is necessary after this is to substitute the appropriate 
quantities m the formula In this case 


130 75 - 3 8 X 7 
“ 15 28 X 9 26 


.91-. 


This value of r is sufficiently high to indicate that there is a 
strong tendency for intelligence-test .scores and average school 
marks to vary together, both bemg high, low, or otherwise at 
the same level. 

The so-called Ayres method for ungrouped series. Although 
the method just given may be considered the standard or con- 
ventional method for computing the coefficient of correlation 
of ungrouped senes, there is another that is probably somewhat 
easier. This is commonly referred to as the Ayres method be- 
cause it was largely due to Ayres’ efforts that it became promi- 
nent,* but it had been suggested by others, especially Hams * 
and Thurstone,* previously This method involves only three 
columns of figures m addition to the ongmal two, instead of 
five, and eliminates negative numbers, but the numbers dealt 
with are larger. It is therefore probably to be preferred to the 
other if computing machines are available, or if the computer 
has a tendency to be confused in dealing with negative num- 


* Leonard P. Ayres, “Shorter Method for Computing the Coefficient 
of Correlation,” Journal of Educaiwncd Retoarch, Vol. 1, March, 1920, 

pp. 216-221. 

*J. Arthur Harris, “The Anthmetic of the Product Moment Method 
of Calculatmg the Coefficient of Correlation,” Amencan Naluralut, VoL 
44, November, 1910, pp 693-699 

*L. L. Thuiatone, “A Method of Calculating the Pearson Correlation 
Coefficient without the Use of Deviations,” Ptycholoffical BuUelin, ViA 
14, January 16, 1917, pp. 23-32 
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here. In theory it is the same as the other method with the 
assumed means taken at zero. Thus the deviations are the 
same as the original scores. 

Either one of two slightly different forms of the formula for r 
may be employed for this method. They differ from that pre- 
viously used m that some of the terms therein are expanded 
and that the factor N is handled somewhat differently. Any 
one of the three forms is easily transformable into either of the 
others These two are ® 






The application of Ajtcs’ method to the same data used in 
the last example is shown in Table XXXIII. Following the 
first two columns, which contain the original scores, are two 
headed and Y" contaimng their squares, and finally one 
headed XY containing the products of the correspondmg pairs 
of measures All five columns are summed and these totals 
provide all the quantities needed for substitution in the formula. 
The numerator of the fraction that gives the value of r consists 
of the total of the last, or XY, column minus the product of the 
totals of the X and 1’ columns divided by the number of cases. 
In the denominator are two expressions under the radical. 


* If az and gy are exp anded itito the t erms from which they came, that 

/ Xy* 

^ —cl and gy into y -j, el; if instead of c* and Cy 

are written and respective!), and if both the numerator and d»- 
I\ A 

nominator are multiphed by A’, the formula, 


Si-y 

.V 


- CzCy 


U jfly 

becomes the iirst of those given above m the text. If numerator and de- 
nominator are again multiplied i>y A’, the second one results. 
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TABLE XXXIII 

Atres’ Method or Compottno the Coefficient of Correlation 
WITH Ungbodped Series 



The firet consists of the sum of the X'^ column mmus the square 
of the sum of the X column over the number of cases, and the 
second the corresponding quantities for F. Mi dripg these sub- 
stitutions the same value of r, ,91 — , is obtam||jpi^ this as by 
the regular method.’ 

’ It will be aoted that the Dumerator and denominator of the final form 
of the fraction shown in Table XXXIII are, respectively, equal to the 
numerator and denominator of the final form in Table I^JIXII multiplied 
by the number of cases, in this instance 20. This is always'^true when the 
Ayres and the ordinary method are compared The ehght discrepancy 
between the product of ^ tunes 141.49 and 2828 52 is merely due to the 
fact that decimals were dropped. 
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A ouxlification of die Ayres method for ungrooped series. 

Ayres has suggested that the method described in the preceding 
section be modified by reducing the sLse of the numbers in- 
volved.* This reduction is accomplished by subtracting from 
the original measures some number almost as large as the 
smallest measure in the series. Some statisticians follow the 
practice of subtracting a number one less than the smallest 
measure in the senes, and some even subtract the smallest 
measure itself, but the wnter recommends that the number 
subtracted bt* the largest relatively round number smaller than 
the smallest measure The reason for this recommendation is 
that the greater ease of subtractmg such a number more than 
balances the slightly larger remainders left. The application 
of this procedure is, of course, equivalent to takmg the number 
subtracted as the assumed mean. 

Table XXXIV^ illustrates this method for the same data 
used in the last examples. The first column was obtained by 
subtracting 70 from each of the scores given m the first column 
of the previous two tables, and the second column by sub- 
tracting 60 from each of those in the second column of the same 
tables. These numbers were chosen as being the largest round 
numbers smaller than the smallest scores m the two aeries, 
which are 72 and 62, respectively. The original senes are not 
reproduced in Table XXXIV because m actual practice there 
is no necessity for doing so All one needs to do is to look over 
each series carefully enough to determine the smallest measure 
in it, then make the proper subtractions and thereby obtain 
series correspondmg to the x and y colunms in Table XXXIV. 
The procedu m ir om that point on is just the same as in the 
regular Ayr(|M|||thod. The x and y entries are squared, each 
column sumraK and likewise the sum of the xy products 
found. ThessfUite then substituted in the same fonnula as was 
used previoudy, giving, of course, the same resi^, .91 — . Not 
only is the fi^ result the same, but the value of the numerator 

'Leonard P. Ayres, “Substituting Small Numbers for Large Ones in 
the Computation of Coefficients of Correlation,'' Journal of Educational 
Retearch, Vol. 2, June, 1920, pp 502-504. 
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TABLE XXXIV 

Atrbs’ Reduced Score Method of Computing the Coefficient 
OF Correlation with Unorouped Series 


X 

y 

J-* 

v’ 


55 

36 

3,025 

1,296 

1,980 

49 

33 

2,401 

1,089 

1,617 

48 

37 

2,304 

1,369 

1,776 

41 

24 

1,681 

576 

984 

36 

29 

1,296 

841 

1,044 

30 

19 

900 

361 

570 

28 

28 

784 

784 

784 

27 

26 

729 

676 

702 

24 

24 

576 

576 

576 

24 

18 

.576 

324 

432 

22 

16 

484 

2,56 

352 

19 

23 

361 

529 

437 

18 

23 

324 

529 

414 

14 

15 

196 

225 

210 

12 

20 

144 

400 

240 

11 

12 

121 

144 

132 

7 

13 

49 

169 

91 

6 

6 

25 

36 

30 

4 

10 

16 

100 

40 

2 

2 

4 

4 

4 

476 

414 

l.),996 

10,284 

12,415 


12,418 - 


476 X4I4 
20 


25«1 K 


2561 S 


/ (i6.996-^^=)(i0,284-^^’) 


V4607 2 X 1714 2 282S 52 


- Bl- 


and of each of the two factors under the radical m the denomi- 
nator is exactly the same as was secured by the other method. 

In using this method it is sometimes desirable to reduce the 
size of the scores by division instead of subtraction, and some- 
times by a combination of the two. For example, if the scores 
in the first column of Table XXXIII were 1250, 1190, 1180, 
and so on, down to 720, it would be desirable to divide by ten 
and then subtract seventy, or what would perhaps be slightly 
more convenient, subtract seven hundred and then divide by 
ten. It frequently happens that all of the measures in a series 
end in one or more zeros, and thus division by ten, one hundred, 
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or even a larger multiple of ten can be very quickly and easily 
accomplished. More rarely one may divide by five, two, ot 
some other number. In all cases, however, it should be borne 
in mind that it is not economical to use this method if the labor 
of reducing the size of the measures is greater than the saving 
in computation resulting from handling smaller numbers. 

If computing machines are bemg used this method is of 
doubtful advantage. If, however, the work is being done with- 
out such mechamcal aids, the wnter recommends this as ordi- 
narily a better method than that previously desenbed. 

Another “short” method for ungrouped series. A method 
often preferable to that just desenbed consists merely in con- 
sidenng the scores m a distribution as being grouped into a 
number of classes, usually not more than twenty, and m assign- 
mg to each score the number of the class within which it would 
fall. Directions for doing this may be stated as follows: Divide 
the total range of tlie variable by 20 and raise the quotient to the 
next higher integer or round number This integer is then con- 
sidered as tlie clafs inten'al, and new values are substituted for 
the original mcasuri's accordmg to the class m which each falls, 
considenng the lowest class as 1, the next as 2, and so on. For 
example, let us consider the first or X senes of measures pre- 
viously used in Table XXXIII The smallest measure thcrem 
IB 72 and the large.st 125, so that the range is 53. Dividing this 
by 20 gives 2.65 The next largest integer is 3 , therefore, begin- 
mng with the lowest score, 72, the first three possible scores, 
that is, 72, 73, and 74, are considered as falling in the first group; 
the next three, 75, 76, and 77, as falling in the second , and so on. 
Doing this, the first two scores, 72 and 74, would both be trans- 
muted mto I’s, the next two, 75 and 77, mto 2’s; 81 and 82 
would both become 4’s, and so on. 

The result of applying this method to both the X and F 
series and of computing the coefficient of correlation from the 
substituted measures is shown m Table XXX^'^ The original 
measures, already given in Tables XXXII and XXXIII, are 
not repeated, but instead the substituted values on the basis of 
X class mtervals of three and F mtc'rvals of two are used. The 
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TABLE XXXV 

CoMPtTTATlON OF COHFFICIKNT OF CORBELATION OF UnOBOUFIID 

Series by Use of Sobstituted Valdes EguivAUcNT to 
Class Deviations 


dx 

dy 


dl 

d;^iy 

18 

18 

324 

324 

324 

16 

16 

2.56 

256 

256 

16 

18 

256 

324 

288 

14 

12 

196 

144 

168 

12 

14 

144 

196 

168 

10 

9 

100 

81 

90 

9 

14 

81 

196 

126 

9 

13 

81 

169 

117 

8 

12 

64 

144 

96 

8 

9 

04 

81 

72 

7 

8 

49 

64 

56 

6 

11 

36 

121 

66 

6 

11 

36 

121 

66 

5 

7 

25 

49 

35 

4 

10 

16 

100 

40 

4 

d 

Id 

36 

24 

2 

6 

4 

36 

12 

2 

3 

4 

9 

6 

1 

5 

1 

25 

5 

1 

1 

1 

1 

1 

158 

203 

17.54 

2477 

2016 


Y a _ _ ~ ^ ^ 1 1 

1754 _ 15 ®’^ ^2477 - VSOFS 'X 4iFM 459 0 


Ayres variation of the formula is employed and the coefficient of 
correlation is found to bo 90—. This agrees closely although 
not exactly with that already determined by the other method, 
.91 — . Also it will be noted by a companson of Table XXXV 
4«th Table XXXTV that the size of the numbers involved in 
the former is less than that of the numbers used in the Ayres 
method.* 

' The poedbility of error or loss in abeolute accuracy due to emplojring 
tnaamuted scores as suggested in the text above is just the same as that 
involved m all computations of the coefficient of correlation in which 
aeofes are grouped into not more than twenty classes. It is true, however. 
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If one is computing many correlations by this transmuted 
score method and the data involved vaiy considerably in their 
sizes, it may be economical to construct a table from which 
such scores can be read off at once. An example of such a table 
may be found m an article by Toops.*® 

Another “short” method of computing the coefficient of 
correlation has been suggested by Walker, This method does 
not require the construction of a correlation table, but instead 
deals with the scores, regardless of their number, in columns. 
The actual computation involved does not appear to be any less 
laborious than that required in Ayres’ method, so that for a 
single correlation the writer is doubtful if the saving by this 
method is great enough to be worth-while. If all possible cor- 
relations between a number of different variables are to be found, 
however, the economy by Walker’s method is greater. It will 
not be given here, but can be found m full m the reference. 

The computation of the coefficient of correlation for correla- 
tion tables by the ordinary method. In actual practice it is 
generally much more common to compute coefficients of cor- 
relation from correlation tables than from simple senes. The 
reason is that in most instances the number of cases concerned is 
large enough to render it easier to compute the coefficient in this 
way than to do so from the ungrouped senes. A correlation 
table, also called a tabk' of double entry, is plotted according to 
the two-axis system bnefly described m Chapter III and em- 
ployed in Chapter VUI The scale for measunng one senes of 
measures is laid off upon the X- or honzontal axis, that for the 

that the difference lietween the result obtained from a groupied correlation 
table, which will be explained later, and the exact scores is often less than 
the difference between the coefficient of correlation from scores trans- 
muted as above and the exact score:., liecause thi.s method of traosmuta-, 
tion IS commonly applied to a ..-mailer niuulier of cases than compooe 
correlation tables, and, therefore, the probability of discrepancy is g n At m: 

“Herbert A. Toops, “Conijiuting Intercorrelations of Tests on the 
Adding Machme,” Journal of Applied Psycholo^, Vol. 6, June, 1922, 
pp. 172-184. 

“ J, F. Walker, “Short Method for Finding Zero Order Coefficients of 
Correlation,” Journal of EducalunuU Psychology, Vol 21, January, 1930, 
pp 65-67. 
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TABLE XXXVI 

Correlation Table for the Data Given on Page 153 




75 - 

80 - 

85 - 

90 - 

95 - 



110 - 

115 - 


125 - 

95 - 




■ 

■ 





/ 


/ 

90 - 




1 

■ 





/ 



85 - 

! 



1 

■ 

// 


/ 





80 - 



/ 

/ / 

/ 




/ 




75 - 



/ 

1 

/ / 


/ 






70 - 

/ 

/ 

/ 










65 - 

■ 

i 

/ 

1 










60 - 

/ 



1 

1 









other upon the Y- or vertical axis. A table is thus formed that 
may be thought of as compos(*d of squares or compartments, 
each of which contains all the measures of a single X and a sin- 
gle Y magnitude. The X magnitudes are commonly indicated 
by figures or occasionally other B3Tnbol8 written horizontally 
across the top of the table, and the Y magnitudes by figures 
or symbols written vertically at the left side of the table. It is 
conventional practice for the values of the A-vanable to mcrease 
from left to nght, and for the values of the F-vanable to increase 
from the bottom up. Just as in a graph a single dot indicates the 
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location of a case by showing its distance from each of the axes, 
so in a correlation table a tally mark entered m the proper 
position indicates the two measures or, m other words, the X 
and Y values for a smgle mdividual. 

The construction of such a table may be illustrated for the 
twenty pairs of measures employed in the computation of the 
coefficient for ungrouped senes.** Table XXXVI shows the 
correlation table for these data They have been grouped into 
classes with a width of five, beginning at 70 for the first or 
X-variable, and at 60 for the second or K-variablc. For the- 
first pair of measures, 125 and 96, a tally mark appears in the 
compartment directly beneath 125- and directly to the nght of 
95-, thus indicatmg that it has an X value as large as 125 but 
less than 130, and a Y value as large as 95 but less than 100. 
For the sc'cond pair of measures, 119 and 93, a tally mark ap- 
pears below 115- and to the right of 90-. Similarly, for each of 
the other pairs a mark has been entered in the table. After this 
has been done the next step is to count the marks m each 
compartment and write the proper number m it. In practice 
this 18 verj' convenumtly done by makmg the tally marks 
with a soft pencil and writing in the numbers with ink, after 
which the pencil marks can be erased easily. The table is 
then totaled both ways and finally appears in the form shown in 
Table XXXVII. A partial check on the correctness of the 
addition may be obtainixl from the fact that the total number 
of cases, or N, which is given in the lower right hand comer of 
the table, is the sum of the row labeled T, and also of the column 
with the same heading. If these do not agree there must be at 
least one error in addition, and perhaps more. 

In connection with a correlation table the temi aaray is more 
or less commonly used to refer to either a row or a column. In 
other words, it refers to the distribution of all measures that fall 
withm a single class of either of the two variables concerned. 

The calculation of the coefficient of correlation from a table 

“ In actual practice so small a number as twenty cases is practically 
never grouiied in a correlation table, but is retained in ungrouped serieB 
form. 
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TABLE XXXVII 

Finai/ Form of Cobbslation Tabm fob Data Givjcn on Paob 153 



B 

76- 

B 

85- 

90- 

B 

100- 

105- 




B 

n 

95- 






1 

1 

1 

u 

1 


1 

2 

90- 








1 

1 

1 



1 

85- 




1 


2 


1 





3 

80- 



1 

2 

1 




1 

1 

! 



5 

75- 



1 


i 2 


1 


! 




4 

70- 

1 

1 

i 

1 



! 




i 



3 

65- 


1 

1 







! 



1 

60- 

1 

1 

1 









1 

1 

T 

2 

2 

3 

2 

3 

2 

1 

1 

1 

2 

0 

1 

20 


of double entry involves the same mathematical steps as in the 
case of simple senes, but because of the different form in which 
the data are presented, the actual procedure differs somewhat. 
To illustrate such a calculation, Table XXXVII is repeated in 
Table XXXVIII and with it is included the necessary work. 
The three columns at the nght of the Y totals or frequency 
column and the three rows just below the X frequency row are 


































TABLE XXXVni 

CoMprTATioN or the CoEmriF.NT of Cokuelatiom for a Correlation Table 
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3 10 X 1 79 5 549 
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the same as those used m computing the standard deviation of a 
grouped series, there being two sets of them because two va- 
riables or senes of measures are concerned. Thus the d column 
and row contam the deviations of Y and X, respectively, from 
the assumed mean. The assumed mean for Y has been taken 
at the mid-point of the 80- class and that for X at the mid- 
point of the 90- class. The fdy column and fdx row contain the 
products of the entnes in the d column and row, respectively, 
by the correspondmg entries in the totals column or row, and 
the/d® column and row, the products of the corresponding d and 
fd entries. 

The other two columns at the nght, headed "Zx and Zxy, are 
not contained in the computation of the standard deviation, 
but are equivalent to the xy column in the computation of the 
coefficient of correlation shown in Table XXXII. Each entry 
in the Zx column is, as its name implies, the sum of the x values 
of the measures m the corresponding row. Thus in the first, or 
95-, row there is one case' which has an X deviation or i of 
-|-5, and another which has an X deviation of +7; therefore 
Zx for this row is -f- 12. In thi* next, or 90-, row there is only one 
case. Its X value is +5, therefore Za; is +5 for this row. In the 
85- row there are two cases with X deviations of +1 and one 
with an X deviation of +3, making a total of +5 for Zx; and 
so on for the other rows Each entry m the Zxy column is 
obtained by multiplymg the correspondmg entry m the Zx 
column by the Y deviation, or d„, associated with it. Thus the 
first entry, 12, is multiplied by 3, giving a Zxy entry of 36; the 
next, 5, is multiplied by 2, giving 10, and so on The column is 
then summed, giving in this case +94, which corresponds to the 
summation of the xy, or XY, column m the computation of the 
coefficient with simple senes This sum is divided by the num- 
ber of cases, in this instance 20, giving the first term in the 
numerator of the formula 


_ 
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Substituting m the formula the other quantities, that is, the two 
corrections and the two standard deviations, gives 


4 70 + 09 
3 10 X 1 79 


. 86 + 


The reader may notice that the value of r just obtained is 
somewhat le.ss than that previously obtained for the same data 
when ungrouped, which was .91 — The reason for this discrep- 
ancy is that by grouping the scores into classes some accuracy is 
sacrificed. If large numbers of cases running into the hundreds 
are concerned, it is rare that the difference between a coefficient 
of correlation calculated from the ungrouped and one from the 
grouped measures is great enough to be significant. With small 
numbers of cases, such as in this illustration,** it is rarely so 
great as 10 and usually less than .05. 

Smee the illustration just given contains a smaller number of 
cases than is usually found in a correlation table, it seems well to 
present a second example of such a table and the accompsmying 
computation of the coefficient when more cases are concerned. 
This will be found in Table XXXIX, which presents the cor- 
relation between the college-freshman marks and the high- 
school averages of (ughty-five individuals. The freshman marks 
are not m numencal teniis but rather in literal symbols that 
are assumed, however, to be an equal distance apart. Such an 
assumption is necessaiy, since the coefficient of correlation can 
be computed only for data in numencal classes. 

The computation in this table follows the same steps as that 
in Table XXXVHI, (‘\ccpt that two additional rows, just 
below the broken line, are added to illustrate possible methods 
of checkmg. The additional step referred to occurs at the 
bottom of the Zx column If the algebiaic sum of this column 
is obtained, as shown in the table, it should be the same as that 
of the fd, row. In this case both are +89. If they do not agree, 
an error has been made somewhere in the work. The two rows 


“ A further discussion of the effect of grouping measures upon the 
obtained value of the coefficient of correlation may be found at the end 
of this chapter. 



COJIFITTATION OF TH* COXITICIBNT OF CoBBILATld^ FOR A COHRKMTIOM TaBLB WITH TH» ADDITION OF CbKTAIH 
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added at the bottom of the table illustrate the computation 
of "Zzy in the other direction. It is possible to compute it in 
either direction, although it is customary to do as was shown 
in the previous table, that is, first to obtam 2i and from it 
'Ztxy. In the first of the added rows "Ly for esich column has 
been obtamed in just the same way as was Sa: for each row. Thus 
in the first or F— column there is one case with a Y deviation of 
— 1 and another with a Y deviation of —3, so that the Sy entry 
for this column is —4. Smce the X deviation for this col umn 
is —4, the product of these, +16, is the entry in the Sary row. 
The algebraic sum of the Sy row, in this case 28, should be the 
same as that of the column Finally, and most important, 
the sum of the Hxy row must be just the same as that of the 
hxy column. In this case both are 368. If this and the other 
needed quantities are substituted in the formula, r is found to 
be .70+, as shown in the table. 

It will Ix^ noticed that in Tables XXXVIII and XXXIX 
each of the steps m the computation of r occurs in the same 
position. It IS very desirable that statistical workers form such a 
habit, as it is helpful in preventing error The writer has found 
the form employed in these tables most convement in his work, 
but does not wush to urge it strongly as being superior to any 
other possible arrangement. 

The computation of the coefficient of correlation for correla- 
tion tables by the Ayres method. The Ayres method is ap- 
plicable to correlation t ables as well as to ungrouped series. Its 
use for this purpose for the same data as are contamed in Table 
XXXIX IS illustrated in Table XL. The procedure is essen- 
tially similar to that illustrated by Table XXXIV except that 
it is adapted to a correlation table rather than to ungrouped 
senes. The dz row and dy column both begin with 1 and mcrease 
up to 12 and 10, respectively, thus avoiding all negative num- 
bers. The procedure in obtaining the entries in the other ool- 
umna and rows is exactly similar to that in the ordinary method 
previously illustrated. After the columns and rows have been 
summed, the proper quantities are substituted in the formula 
given on page 155. Doing so, as is illustrated at the bottmn ci 
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the table, r is found to be equal to .70+, just the same as the 
value obtamed by the ordinary method. 

It does not appear to the writer that the saving of labor in 
emplo 3 ung the AjTes method with correlation tables is so great 
as that in employing the Ayres reduced score method with un- 
grouped senes. In many cases the means and standard devia- 
tions are desired as well as the coefficient of correlation, and if 
they are found by the Ayres method, the only advantage over 
the ordinary method is the avoidance of mmus signs. Unless 
one is unable to handle such signs without danger of error, the 
wnter does not recommend that this method be employed in 
such cases. If, however, the means and standard deviations 
are not desired, and if calculating machines are available for 
use, this method is probably to be preferred to the ordinary 
method. 

Other methods of computation. Although only a few varia- 
tions of the formula for the cwfficient of correlation have been 
given in the preceding discussion, many vanations of it have 
been suggestiKl and employed by different workers and under 
different conditions The conditions under which it is econom- 
ical to use most of th(>m, however, arise so rarely that it does 
not seem worth-while to mclude them in this text,. If the reader 
is further interested in the matter, he is referred to an article 
by Symonds,'^ m which fifty-two forms of the formula for r 
are given 

Workers in this field have suggested vanous forms of correla- 
tion charts as aids in the computation of the coefficient of corre- 
lation when the data are grouped m a table. Some of these 
charts employ the ordinaiw product-moment or the Ayres for- 
mula as already given, whereas others are based upon varia- 
tions thereof contained among the hst given by Symonds. 
Among these charts may be mentioned those by Ackerson,“ 

Percival M Symonds, “Variations of the P*roduct-Moment (Pearaon) 
Coefficient of Correlation," Journal of Educalional Psychology, Vol. 17, 
October, 1926, pp. 458-469 

*• Luton Ackerson, “A Peanon-r Form for Use with Calculating Ms- 
chmes,” Journal of Educational Psychology, Vol 19, January, 1928, pp. 
6+flO. 
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Anderson and Toops,** Dvorak,” HoLonger,” Justice,” Lauer,* 
Otis,** and Thurstone.** The writer does not strongly reocHn> 
mend the use of any of these charts, however, because it does 
not appear to him that they possess any distinct advantages 
over the usual form of calculation such as has been given in 
this book. 

In connection with the coefficient of correlation it should be 
mentioned that in addition to the use of the ordinary adding 
and computing machines m its calculation, a few machines 
have been designed particularly for this purpose. One of the 
most efficient is that of Hull.** This machme is relatively ex- 
pensive and veiy few reproductions of the onginal one have 
been made. A decidedly less expensive machine is that of Sea- 
shore.** One that works on a quite different pnnciple has been 
described by Ford.** Also vanous computmg and tabulating 
machines not particularly designed for use in connection with 
coox^tion may be employed therefor. Among the best descrip- 

*•1^6' Dewey Anderson and Herbert A Toops, “A New Apparatus for 
Plotting and a Checking Method for Solving Large Numbers of Inter- 
ooirelations," Journal of Edwaiional Psychology, Vol 19, December, 
1928, pp 650-657; Vol. M, January, 1929, pp 36-43 

” August Dvorak, “Dvorak Correlation Chart” (New York, Longmans, 
Green, & Co ). 

“ Karl J Holzinger, Staiutical Methods for Students in Edueatton (Boston, 
Ginn & Co , 1928), p 155 

“W. A. Justice, “Correlation Sheet” (Cincinnati, C A Gregory Co ). 

“A. R. Lauer, “Simplex Correlation Form" (Minneapolis, The Educa- 
tional Test Bureau). 

*' Arthur 8 Otis, “The Otis Correlation Chart,” Journal of Educa- 
tional Research, Vol. 8, December, 1923, pp 440-448 Also, Statistical 
Method in Educational Measurement (Yoiikers-on-Hudaon, World Book Co., 
1926), p. 195. 

” L. L Thurstone, “A Data Sheet for the Pearson Correlation Coeffi- 
cient,” Jofumal of Educational Research, Vol. 6, June, 1922, pp. 49-66. 

•’Clark L. Hull, “An Automatic Correlation Calculating Machine,” 
Journal of the American Statistical Associaiion, Vol 20, December, 1925, 
pp 522-^1. Also, “An Automatic Machine for Making Multiple Apti- 
tude Forecasts,” Journal of Educational Psychology, Vol 16, December, 
1926, pp. 693-59R 

*’ “Psychological and Physiological Apparatus and Suppliea’^jChioago, 
C. H Stoeltiag Cq^ 930), pp 1-2. (Catalog.) 

“ Adelbert Fordn|fflbia Correlator,” Journal of Experimental Ptyeholagy, 
Vol 14, AprU, 194^^, 155-163. 
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tions of such adaptations are those of Warren and Mendenhall 
and of Royer and Toops “ for the Hollerith Tabulating Ma- 
chine, that of Tremmel and Weidemann ^ for the Monroe 
Calculator, and the more general one of Feldstein ® 

Computing intercoirelations among several variables. If one 
is interested not merely m the correlation between two vari- 
ables but in the intercoirelations among several variables, the 
work that would be required for a complete computation of 
each coefficient can be appreciably shortened. How this may 
be done is illustrated by Table XLI, which shows the compu- 
tation of the ccx'fficients of corndation of each of four vanables 
with each of the others. The Ayres method with reduced scores 
has been used Thus the first four columns, headed 1, 2, 3, and 
4, contain the values left after the value of the smallest measure 
in each column has been subtracted from ah of those therem. 
The second set of four columns contains the squares of the en- 
tries in the first set, and the final group of six, the products of 
the various possible combinations of thesis entries. Thus the 
first column in this part of the table contains the products of 
the entries in columns 1 and 2, the next column, of those m 
columns 1 and 3, and so on All the columns are then summed, 
giving the summations of the measures themselves, of their 
squares, and of their products All that is noccssarj' then is to 
substitute in the foniuila the proper sums for the coeflBcient 
bemg obtained One additional step, which saves some labor, 
has been taken however Immediately below the sums of the 
second set of four columns are four other numbers. These are 

“Richard Warren and Roiiert M Mendenhall, “The Mendenhall- 
Warren-Hollenth Correlation Method,” C(dumbia Univernly Statutical 
Bureau Document, No 1 (New York, Colrimbia University, 1929), 37 pp. 

Elmer B. Royer and Herlicrt A Toops, “The Statistics of Geometri- 
oally Coded Scores,” Journal of the American Staltettcal Association, VoL 
28, June, 1933, pp 192-198 

" E. eL Tremmel and C C Weidemann, “A Machine Method of Calcu- 
lating tb» Pearson Correlation Coefficient,” University a/ Nebraska PvhU- 
eation, No. 72, June, 1930, IS pp 

” Marc J. Feldbtem, "A New Technique for Computation of 

Coefficient* of Correlation,” Jotinud of Experimmj^-f^ducatum, Vol. 2, 
March, 1984, pp 278-282. 
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29 51 21 74 • 26 61 21 74 21 74-26 81 
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the values of the expressions under the radical, which appear 
in the denominator of the formula used. By securing them 
first and writing them in the denominators instead of writing 
out the original expressions whose values they are, the work is 
simplified somewhat. The first one of them, for example, equals 

= 29.51. Substituting the sums of the first 

and last sets of columns and the expressions just described, 
the values of the six coefficients of correlation possible with 
four variables are found as shown in the table. 

The saving of work in this method results because it is neces- 
sary to find the various summations of the measures and their 
squares only once, although each is used m finding three of the 
coefficients The same principle may be apphed in dealing with 
intercorrelations among several vanables tabulated m corre- 
lation tables, but will not be illustrated here In such cases one 
must compute the products of the two different vanables for 
each table, but need obtam the sums of the measures and of 
their squares only once for each vanable concerned. This 
method is legitimate only when exactly the same cases are con- 
cerned in all the tables. 

Correlation between one variable and the sum or average of 
two others. Although the somewhat labonous methods of 
multiple correlation must commonly be apphed when it is 
desired to find the correlation between one vanable and a com- 
bination of several others, it is possible to find a correlation 
between one and the sum or average of two others without resort- 
ing to multiple correlation. All that need be known is the stand- 
ard deviations of the two vanables being correlated with the 
third one and the ordmary coefficients of correlation between 
each of the three pairs formed by the three variables. If 1 is 
used to refer to a vanable that is to be correlated with the sum 
or average of two others denominated 2 and 3, the formula is 



'"KJ + j) orr 




ritgj -j- r nff} 

-|- ff* ~l- 2rjsa'i<r» 


Thus, for example, if gj = 4.5, g» = 8, ru = 60, rv* = .52, 
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and rsj = .35, the formula gives 

■60 X 4 5 -t- .52 X 8 
^4.5* + 8® + 2 X .35 X 4.5 X 8 

which = .66. 

General formulae, which may be used for any number of 
variables either correlated or uncorrclated with one another, 
have been given by Dickey,^ but will not be included here. 

Computing correlation for measures not in series. It some- 
times happens that one desires to find the correlation between 
two or more sets of measures that cannot properly be divided 
into as many senes. For e\ample, if one is correlating similar 
traits or measurements of twins, there is no way to determine 
which twin should be considered as belonging m one senes and 
which in the other. The conventional practice in connection 
with such a situation is to enter each pau’ twice in the correla- 
tion table, reversing the order the second time from that em- 
ployed the first. For example, if one twin makes a score of 20 
and the other of 18, one entry is made in which 20 is considered 
as the .^-variable and 18 as the F-variable, and another m 
which 18 IS taken as the X-vanable and 20 as the F-variable. 
Doing this, of course, doubles the number of entries m the cor- 
relation table 

The necessity of constructing a correlation table, however, 
has been obviated by certain suggested formula. The first of 
these was proposed by Furfey,*" and is as follows 

^ 4A^Z XF - (2.Y + SF)^ __ 

'' + 2F') - (SX + 2F)* 

Goodenough has suggested the following, which is equivalent 

•John W Dickey, “Combining Zero-Order Correlation Coefficients,” 
Jowrrud of Educational Psycluilogy, Vol. 24, February, 1933, pp 123-1^. 

•Paul Hanly Furfey, “A Formula for Correlating] Interchangeable 
Variables,” Journal of Educational Psychology, Vol 18, February, 1027, 
pp. 122-124. 

“ Florence L Goodenough, “A Short Method for Computing the Cor- 
relation between Interchangeable Variables,” Journal of Educational 
Ptyekology, Vol. 20, May, 1929, p. 386. 
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to Furfey’s, but shorter: 


N 


In its application the correction and standard deviation are 
computed for all of the measures thrown into a smgle series. 

TABLE XLII 


Fubtet’s Method of Computino the (Coefficient of Correlation fob 
Data Which Cannot Be Grohped into Two Series 



4 10 498 - (78 + r>.=>)2 19,920 - 17,689 

’’ “ 2 10(702 + 397) - (78 + 55)» ~ 21,980 - 17,689 


The application of Furfey’s method is illustrated by the set 
of data presented in Table XLII These represent the scores 
of ten pairs of twins on a twenty-word spelling test In arrang- 
ing them in two columns the larger one of each pair of scores 
has been entered in one column and the smaller one of each 
pair m the other, but this is not neci'ssaiy In this example the 
onginal scores given in the X and T columns have been reduced 
by subtracting 8 from each, and the coefficient computed from 
the resulting enrries in the jr and y columns When such a sub- 
traction IS m.ade, it should bi> the same for both columns. 

The Goodenough formula may be apphed to the same data 
with the same result as follows* 

4 ^ _ P „„ 

10 ® 49 8 - 44.2225 5 5775 

^ 107275 “ 10.7275 1077275 
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In this method the c and <r used are those for the whole numbw 
of data, in this case for the twenty measures. Therefore c is 
obtained by adding the sums of the x and y columns and divid* 

78 *4* 55 

ing by the number of cases, here 20. Thus c = — — = 6.68. 

Similarly the sums of the and columns are added as the 
first step in securing <r. Dividmg their sum, 1099, by 20 gives 
54.95. Subtractmg c^, which equals 44.2225, from this, the 
result is 10.7275, which equals ff*. The two formulae yield 
identical results, .52. Although the formula for the Good- 
enough method is shorter than that for Furfcy’s method, the 
actual amount of computation required differs very httle. On 
the whole, Furfey’s method will probably be preferred by those 
who are accustomed to working with the Ayres method for the 
ordinary coefficient of correlation, whereas that of Goodenough 
will be preferred by those who use the regular product-moment 
method. 

Loss of accuracy due to grouping. A question that arises in 
connection with the calculation of coefficients of correlation 
from grouped data is that of how great a sacrifice of accuracy 
the use of groups involves. It is generally assumed that, if from 
ten to twenty groups are employed and if the number of cases 
is reasonably large, the results from ungrouped data and from 
the same data when grouped w'lll be practically identical. 
Actual experimentation with such data shows that this does 
not always follow. A study by Lauer mdicates that the fol- 
lowing factors operate to cause differences between the coeffi- 
cients obtamed by the two methods. These are given in order 
of the amoimt of the apparent effect 

1. Difference in variability of the two si'ts of measures. 

2. Skewness of the two sets of measures 

3. Difference in shape of the two distnbutioiis. 

4. Size of class interval. 

To this list should be added the number of cases involved. 

•*Alvhh R. Lauer, “An Empirical Study of the EffecU of Grouping 
Data m Calculation of R by the Pearson Products-Moment Method," 
Journal oj Applied Psychology, Vol. 14, April, 1930, pp. 182-189. 
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Since the variability, skewness, and shape of distributions are 
fixed, it appears that probably the chief thing the worker can 
do to avoid discrepancies is to select the best possible intervals 
according to the principles suggested in Chapter II. 

In order to secure some evidence as to the amount of inac- 
curacy caused by grouping data in classes, the writer had ninety 
coefiicients of correlation computed for exact scores, and like- 
wise after the scores had been classed mto five, ten, and twenty 
groups. In thirty of the ninety mstances only 25 measures were 
concerned, m thirty there were 50, and in the remaining thirty, 
100. Without going into detail, his findings may be stated 
briefly as follows . Except in the case of unusual freakish distri- 
butions the difference's between the coefficients from exact 
scores and those from scores grouped m five classes exceeded 
.10 rarely and were less than .05 m well over half of the oB^. 
When ten classes were used the differences were very rarely so 
great as 05 and more than two-thirds of them were not greater 
than ,02. When twenty classes were used only about 5 per cent 
of the differences were greater than .02 and about three-fourths 
not greater than .01. On the whole the differena^s were some- 
what more often in a negative than in a positive direction, that 
is, the coefficients from grouped measures tended to be smaller 
than those from (*\act measures. 

In the case of the few unusual freakish distributions, some 
differences much larger than those mentioned m the preceding 
paragraph were found Indeed, when only five classes were 
used one such difference was greater than 50 and a few others 
.25 or more. In ever\' case these were corn'lations which be- 
came zero when the' measures were grouped in a few classes. 
This was due to the fact that all of the cases that did not fall 
in the class with a zero deviation for one vanable did fall in the 
zero class for the other. In all of these unusual cases the coeffi- 
cients for the grouped senes were smaller than those for the 
exact measures. 

The general conclusion to be drawn from this and other simi- 
lar investigations is that if the numlier of classes in both vari- 
ables is ten or more it is quite unhkely that the loss of accuracy 
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in grouping scores will be large enough to be of any practical 
importance. In most cases it will be considerably less than the 
possible errors in the coefficients of correlation due to the effect 
of vanable errors therein, or to the unreliability of sampling. 

Es timating coefficients of correlation from correlation tables. 
It is helpful for one working vnth correlation to be able to esti- 
mate without too great error the size of the coefficient of corre- 
lation for a given set of data Although this ability is desirable 
whether the data are arranged in columns or in a correlation 
table, this discu&sion will be limited to the latter case. The 
reason is that correlations arc much more frequently computed 
from tables than from columns and that it is considerably more 
difficult to acquire the ability mentioned for series in columns 
than for those in tables 

The best method by which an indmdual can develop this 
ability is to practice making such estimates. He should look 
at a correlation table for which he docs not know the coefficient, 
estimate what it is, and compare his estimate with the actually 
obtained value. If one has available a number of tables for 
which the coefficients have already been computed he can 
obtain practice by concealing the value of each coefficient until 
after he has estimated it. If the discrepancy between the esti- 
mate and the true value is very large an attempt should be 
made to determine why the error occurred. This involves 
examimng the distribution m the table and noting character- 
istics that appear to have produced the large error. By per- 
severmg m such practice, sufficient ability in estunatmg should 
be acquired so that, except in cases m which one or both series 
are veiy a 83 munetncal in their distnbution, or otherwise un- 
usual or freakish, errors as large as .10 should be quite rare and 
many, perhaps most, estimates should not be in error by more 
than .05. 

To assist the reader in gaining some idea of the distribution 
of measures in correlation tables having certain values of the 
coefficient. Tables XLIII and XLIV have b«>en prepared. The 
first illustrates each value of the coefficient from .00 to 1.00 
at intervals of .10 for two symmetrical and approximately 
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TABLE XLIII 

CoBBKUATiON Tables iLHjSTRATiNa CoEFnciENTs of Cobbelation of 

Various Sizes 


1 

2 

4 

2 

1 

1 

2 

3 

2 

2 

1 

1 

3 

3 

2 

2 

4 

8 

4 

2 

2 

4 

6 

6 

2 

1 

4 

8 

4 

3 

4 

8 

16 

8 

4 

3 

6 

22 

6 

3 

3 

8 

18 

8 

3 

2 

4 

8 

4 

2 

2 

6 

6 

4 

2 

3 

4 

8 

4 

1 

1 

2 

4 

2 

1 

2 

2 

3 

2 

1 

2 

3 

3 

1 

1 


r 

= 00 



r 

= 

10 



r 

= 

20 



1 

1 

3 

2 


1 

3 

3 

3 



3 

3 

4 

1 

3 

8 

5 

3 

1 

2 

8 

6 

3 


4 

7 

6 

3 

4 

8 

16 

8 

4 

3 

8 

18 

8 

3 

3 

7 

20 

7 

3 

3 

.') 

s 

3 

1 

3 

6 

8 

2 

1 

3 

6 

7 

4 


2 

.3 

t 

1 


3 

3 

3 

1 


4 

3 

3 




r 

= 30 



r 

= 

40 



r 


50 




2 

3 

5 



1 

3 

6 



1 

2 

7 


4 

.5 

8 

3 


3 

5 

9 

3 


1 

4 

13 

2 

2 

5 

24 

5 

2 

1 

5 

28 

5 

1 

1 

4 

30 

4 

1 

3 

8 

5 

4 


3 

9 

5 

3 


2 

13 

4 

1 


5 

3 

2 



6 

3 

1 



i 

2 

1 




r 

= ()0 



r 

= 70 



r 


80 



2 8 

10 

4 14 2 

20 

4 32 4 

40 

2 14 4 

20 

8 2 

10 

r = 90 

r = 1 00 


normal distnbutions of one hundred cases, grouped in five 
classes. The upper left portion of the table shows an arrange- 
ment of the data yielding a value of .00 for r, that is, having no 
correlation at all. In each succeeding portion of the table the 
data tend to approach more closely a diagonal from the lower 
left to the upper right comer until in that for r = 1.00 they 
all lie upon such a line. 

In Table XLIV are slx correlation tables more similar to 
those found in actual practice with coefficients ranging from 
.11 up to .95. These, of course, show the same tendency as was 























nuTiNO CoBmciKNTs or Cobrklation or Various Son 



183 










184 STATISTICAL METHOD IN EDUCATION 

commented on above, that as the coefficient becomes higher 
the entries are more closely grouped along a diagonal from the 
lower left to the upper right comer. 

Correlation based upon mean deviations. It has been sug- 
gested by Davies ” that a coefficient of correlation based upon 
mean deviations from the mean rather than standard devia- 
tions therefrom may be employed. The ordinary coefficient 
of correlation is generally recogmzed to be somewhat unsatis- 
factory when only a few cases are concerned or when the dis- 
tributions are far from normal. In such cases the method sug- 
gested by Davies appears to have some merit. It is, however, 
veiy rarely employed Indeed, the wnter has never seen it 
used in connection with educational work, and for this reason 
does not recommend it to the ordinary worker in education. 

Exercises 

1. Cbtnpute the coefficient of correlation for each of the following 
sets of date according to the method dlustrated in Table XXXII. 



A 

B 


C 

D 

E 

44 

123 

12 

82 

3 

14 

75 

90 

76 

85 

50 

108 

9 

87 

4 

10 

78 

94 

81 

92 

40 

98 

26 

78 

2 

14 

75 

89 

76 

84 

48 

106 

8 

80 

2 

13 

74 

97 

80 

82 

29 

sa 

20 

80 

9 

6 

70 

91 

84 

87 

59 

119 

16 

89 

4 

9 

75 

95 

90 

88 

35 

94 

1 

93 

9 

15 

82 

98 

93 

90 

45 

105 

30 

8;i 

4 

4 

77 

90 

83 

83 

62 

111 

12 

87 

9 

7 

84 

t« 

92 

86 

69 

129 

20 

88 

. 8 

16 

82 

92 

88 

92 

13 

71 

1 

87 

1 

13 

79 

95 

89 

87 

42 

101 

2 

84 

1 

12 

79 

90 

89 

88 

56 

116 

26 

93 

4 

15 

76 

97 

87 

89 

55 

116 

2 

87 

1 

6 

74 

96 

88 

90 

50 

101 

16 

81 

3 

9 

77 

89 

88 

87 

69 

117 

28 

90 

1 

10 

85 

90 

88 

86 

41 

100 

23 

81 

5 

14 

76 

88 

87 

82 

50 

108 

4 

87 

6 

13 

82 

91 

80 

83 

34 

92 

27 

74 

8 

6 

70 

82 

80 

84 


•> George R Davies, “First Moment Correlation,” Journal of the Ameriam 
StatteUeal A»goe%ation, Vol. 25, December, 1930, pp 413-427 
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1. (Conf.) 

A 

B 

C 

D 

E 

67 

125 

7 82 

4 1 

73 91 

85 

88 

43 

103 


9 1 


84 

86 

41 

99 


0 13 


85 

88 

54 

115 




80 

82 

56 

115 




91 

91 






84 

88 


2. Compute the coefficients of correlation for C of Exercise 1 accord- 
ing to the method shown in Table XXXIII (p 150), and of D and E 
by that m Table XXXl V (p 158) 

3. Compute the coefficients of correlation of A and B of Exercise 1 
by the method illustrated in Table XXXV (p 100) 

4. Tabulate each of the following sets of measures in a correlation 
table 

A. 88-72, 88-89, 82-86, 83-88, 88-87, 89-90, 74-71, 82-71, 83-84, 

82-87, 71-70, 69-77, 83-89, 90-90, 93-93, 90-88, 86-86, 77-77, 

82- 82, 75-75, 76-76, 92-92, 89-88, 81-81, 87-87, 80-80, 76-76, 
92-92, 88-88, 84-78, 75-70, 76-76, 81-75, 78-75, 76-71, 77-70, 
74-78, 81-71, 83-86, 74-71, 94-94, 94-82, 76-70, 80-88,83-83, 
81 -82, 77-71, 79-79, 74-74, 82-74, 85-79, 77-79, 77-7^ 85-82, 
71-77, 77-71, 74-74, 74-90, 79-85, 95-94, 76-65, 71-75, 90-92, 

83- 81, 80-86, 81-77, 83-84, 84-84, 78-82, 80-76, 70-77, 82-74, 
89-90, 75-78, 69-71, 88-86, 82-80 

B. 10-222, 5-74, 3-24, 12-231, 3-25, 12-276, 2-23, 9-130, 2-31, 

6- 106, 5-53, 1-11, 7-70, 3-52, 7-105, 4-A9, 36-890, 5-79, 
5^0, 17-303, 4-32, 15-355, 2-31, 4-67, 9-190, 3-20, 11-181, 
4-55, 6-125, 13-310, 16-275, 5-66, 6-86, 1-20, 4-88, 8-143, 
2-44, 6-85, 5-78, 3-30, 7-79, 10-180, 7-166, 7-133, A415, 
8-90, 1-18, 11-125, 12-195, 9-119, 43-1078, 31-635, 10-202, 
12-268, 19-355, 41-890, 20-457, 11-165, 3-15, 11-255, 9-122, 
4-58, 38-778, 3-55, 8-116, 2-27, 50-1 1(W, 16-335, 6-104, 

7- 104, 2-27, 18^35, 11-217, 10-126, 20-350, 30-762. 

C. 11-16, 2-10, 22-8, 7-8, 4-2, 1-5, 5-2, 12, 2-2, 2-6, 6-9, 3-12, 

2-2, 2-3, 4-10, 3-12, 11-3, 4-2, 4-5, 2-9, 4-4, 2-4, 1-13, 1-2, 
2-2 5-5, 5-5, 2-1, 6-7, 6-7, 1-6, 3-2, 4-8, 6-7, 8-4, 4-36, 
2-8, 2-12, 13-12, 4-2, 6-3, 10-6, 2-11, 2-8, 12-7, 1-7, 5-3, 

8- 10, 7-13, 2-17, 3-2, 3-17, 2-15, 5-40, 11-17, 6-4, 4-4, 
6-3, 2-2, 1-3, 6-l(), 5-16, 2-43, 2-9, 1-31, 7-18, 5-15, 2-12, 
4-18, 1^, 1-5, 11-5, 3-2, 21-25, 14-34, 7-4, 3-10, 3-4, 9-12, 
4-5. 

D. 21-79, 28-74, 25-79, 40-59, 52-44, 70-40, 30-60, 21-74, 77-21, 
65-30, 29-67, 85-20, 50-50, 52-42, 45-52, 69-40, 68-30, 
64-40, 42-57, 71-28, 20-89, 83-24, 63-43, 33-66, 55-44, 
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73-27, 22-81, 45-63, 54-38, 25-76, 77-23, 66-35, 29-73, 

28-74, 66-41, 58-46, 69-32, 27-68, 78-32, 31-76, 52-41, 

55-35, 63-30, 28-80, 47-56, 84-26, 82-25, 73-34, 61-38, 

58-39, 34-62, 71-36, 71-34, 22-79. 

5. Compute the coefficient of correlation for each of the tables 
construct^ in Exercise 4 by the method shown in Table XXXVIII 
(p. 165). 

6. Check the computation of the coefficients of correlation found in 
Exercise 5 by the method shown in Table XXXIX (p. 168). 

7. Compute the coefficient of correlation for each of the tables con- 
structed in Exercise 4 by the method illustrated in Table XL (p. 170). 

8. Compute the intercorrelations among the following senes as 
shown in Table XLI (p. 174) 


A B 


16 

6 

4 

83 

83 

83 

76 

25 

2 

4 

89 

9 () 

89 

89 

14 

9 

4 

76 

83 

76 

83 

17 

1 

4 

72 

80 

82 

72 

27 

7 

7 

83 

96 

89 

83 

18 

1 

8 

89 

89 

89 

96 

7 

1 

3 

96 

82 

89 

96 

8 

5 

3 

74 

89 

89 

74 

15 

1 

4 

89 

96 

74 

89 

12 

1 

3 

82 

82 

89 

89 

68 

23 

72 

89 

82 

89 

89 

28 

23 

7 

83 

89 

83 

83 

35 

1 

16 

96 

89 

89 

83 

40 

10 

15 

89 

85 

94 

94 

30 

8 

8 

89 

89 

83 

89 

18 

1 

6 

89 

89 

82 

89 

16 

4 

2 

81 

81 

74 

81 

12 

5 

4 

68 

76 

82 

89 

17 

2 

8 

76 

89 

96 

76 

27 

1 

9 

82 

84 

84 

89 

6 

1 

5 

83 

72 

8.5 

89 

19 

1 

10 

82 

89 

89 

82 

11 

2 

2 

89 

89 

82 

96 

10 

1 

2 

82 

74 

82 

74 

23 

1 

5 

89 

80 

89 

85 

14 

6 

2 






6. Compute the coefficient of correlation by Furfey’s formula for 
each of the two senes below. Check the result by applying Good- 
enough’s formula. 
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A. 82-85, 87-94, 78-88, 80-82, 80-88, 89-88, 93-91, 83-86, 87-86, 

88-92, 87-87, 84-88, 93-89, 87-90, 81-87, 90-86, 81-82, 83-87, 
74-86, 82-88, 82-86, 84-88, 88-82, 90-91, 89-88, 86-88, 91-89. 

B. 4-2, 1-2, 4-3, 15-3, 7-3, 13-14, 3-3, 2-1, 8-7, 7-4, 3-2, 2-2, 

1-1, 21-15, 2-2, 3-3, 3-3, 4-4, 3-1, 3-3, 17-13, 3-3, 2-2, 3-2. 



CHAPTER X 


THE INTERPRETATION OF THE COEFFICIENT 
OF CORRELATION 

The two chief functions of the coefficient of correlation. ‘ 

Although the coefficient j)f correlation is an exact numencal 
expression that shows thi' degree or amount of relationship 
betw een two series of pain'd facts, it is usually rather difficult 
to interpret in geni'rally understandabk' terms Pi-rhaps the 
first step toward making such inti'rpretation satisfactorily is 
to recognize that the coefficient is almost always computed for 
one or the other of two chu'f purposes One is to determine 
vrfi ether or not there is any definite relationship between the 
two sets of data under consideration, and the other to deter- 
mine, how close the existing relationship is. In direct question 
form these may be stated as “Are these' two characteristics 
related to each other"”’ and “How dost' is the relationship 
between these tw'o charactc'iistics'^’’ The answer to the first 
is obtained by comparing the coefficient of correlation with 
some measure of reliability or possibility of error, and then, 
by the method desenbed in Chapter XIX, determining the 
chances that the coefficient is really significant. The answer to 
the second involves the determination or expression of the 
closeness of relationship between two paired series correspond- 
ing to the value of the ciK'fficient of correlation that has been 
found. Since the mterpretation of the coefficient of correlation 
from the first standpomt is sunilar to that of other measures, 
and the whole topic is dealt with later in this volume, and, 
since its interpretation from the second standpoint is much 
more difficult and peculiar to it, the bulk of this chapter suggests 
various ways of interpreting the coefficient of correlation as a 

* For a further discusmon of these two functions see. A. 8. Barr, “The 
Coefficient of Correlation,’’ Journal oj Educational Retearck, Vol. 2S, 
January, 1931, pp. 55-60. 
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measure of the closeness of relationship between two series of 
data. 

The coeflDicient of correktioa as a minimum measure of rela- 
tionship. There arc at least two reasons why the coefficient of 
correlation as determined by actual computation may be 
thought of as a minimum measure of the true amount of rela- 
tionship c.Yisting. One is that, as has already been stated, the 
coefficient measures n'ctihnear or straight-Iine relationship 
only Therefore if the true ndationship is cur\'ilmear, the true 
correlation is higher than is indicated by ihe obtained value 
of the coefficient. In the second place, \'ariable or accidental 
errors enter into practically all measurements. The effect of 
these errors is to Iowit the obtained value of the coefficient oi 
correlation below the true value It is possible to correct for 
such errors if the coefficients of reliability of the measures dealt 
with are known, and thu.s to obtain an approximation to the 
true correlation betwec'n the two senes The method of domg 
this and a discussion of when to do it will be given in the next 
chapter. 

The interpretation of the coefficient of correlation in terms of 
adjectives. Some writers have undertaken to define the mean- 
ing of coefficients of correlation by means of certain adjectives, 
which they apply to coefficients of various sizes Rugg,* for 
example, states that his experience “has led him to regaid 
correlation as ‘negligible’ or ‘indifferent’ when r is less than 
.15 to .20, as being ‘present but low’ when r ranges from .15 
or .20 to 35 or .40, as being ‘markedly present’ or ‘marked’ 
when r ranges from 35 or .40 to .50 or .60; as bemg ‘high’ 
when it is above .60 or .70 With the present limitations on 
educational testing few correlations in testing wall run above 
.70, and it is safe to regard this as a very high coefficient.” 
McCall ’ likewise offers a statement of this sort, but briefer 
than Rugg’s, as follows: 

• Harold O Rugg, Statistical Methods Applied to Eduaiiion (Bostoo, 
Houghton Mifflin Co , 1917), p. 256 .\lso, A Pnmer of Graphics and Sta- 
lislicsfor Teachers (Boston, Houghton Mifflhn Co , 1925), p 97 

* William A. McCall, How to Measure in Education (New York, Mao- 
millan Co , 1922), pp 392-393 
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When r is 0 to ±.4 correlation is low, or 

.4 to ^.7 correlation is substantial, or 
±.7 to =*=1.0 correlation is high. 

The present writer believes that the use of adjectives is de- 
cidedly unsatisfactoiy and indeed often meaningless unless 
they are employed m a definitely limited situation. Whether 
a coefficient of correlation is high or fair or low depends upon 
the purpose for which it is employed and the data for which 
it is computed. A coefficient of .30 or .40 is high enough to 
indicate that there is definite relationship between the two 
things correlated, but is so low that estimates of one of the 
traits from the other are scarcely better than mere guesses. A 
correlation of .80 between school marks in chemistry and m 
physics is relatively high since the usual correlation between 
such marks is considerably lower than this, but a correlation 
of the same size between two apphcations of the same mdi- 
vidual mtelhgence test is relatively low smee the best of such 
tests 3neld coefficients of above .90. 

IntaQiretation in terms of coefficients obtained in familiar 
mtuatidns. One method of interpreting a coefficient of corrclar 
tion is to compare it with those commonly obtained in situations 
with which we are more or less familiar For evample, the 
ordmary person has some idea, vague though it may be, of how 
closely height and weight correlate, of how much children 
resemble their parents in certain easily noted traits, such as 
height, color ofliair, color of eyes, and so forth Therefore if the 
correlation in a less familiar situation is found to be about the 
same as that in a more familiar one, this fact conveys some 
idea of how close the relationship is. This procedure is of only 
general help, but seems to possess enough merit to justify the 
insertion of Table XLV. In this are given the ranges that in- 
clude most of the coefficients of correlation commonly found in 
certain more-or-less famihar situations. 

Interpretation in terms of causal factors. A suggested method 
of interpreting coefficients of correlation is in terms of the propor- 
tion of causes or factors operating to influence the sizes of the 
two variables, that is common to both. From this standpoint a 
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TABLE XLV 

SizBS OF Coefficients of Correlation Commonly Found fob Certain 

Relationships 


School marks in different subjects supposed to have little m 
common, such as foreipi language and industnal arts, Eng- 
lish and music, and so forth 

School marks in subjects supposed to be somewhat simdar, 
such as English and foreign language, algebra and geometry, 
and so forth 

Heights of fathers and heights of sons 

First and second atijilications of generally accepted standardized 
group tests 

First and second ajiiilioalions of the liest individual intelligence 


.30-,50 

40-.70 

.4O-.0O 

80-98 


tests 

Ages of husbands and ages of wives 


90-98 

85-95 


coefficient of correlation may be considered as a decimal fraction 
which shows what proportion of the causes that affect the siaes 
of two vanables is coimnon to both. This mterpretation depends 
upon the assumption, rarely absolutely valid, that the causes 
themselves are not correlaU'd with one another. It is |Ak> as- 
sumed that the factors are of equal effect, or at least tiiat the 
average effect of the common factors and of each group of non- 
common factors IS the same. 

This method of mterpretation may be written in formula form 
thus 

VNTWt 

in which stands for the number of factors common to the 
two vanables, Ni for the number in one vanablc, and Nt for 
the number m the other In other words, the number of com- 
mon factors 18 divided by the georaotnc mean of the numbers of 
factors of the two vanables For example, if there are ten 
factors that contnbute to the size of one variable or series of 
scores, and twenty that contribute to the size of another, and 
five are common. 
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It is impossible to compute coefficients of correlation by the 
formula given above, since we can rarely if ever determine the 
total number of factors operating and the relative contnbution 
of each. Yet it seems to afford a somewhat helpful interpretation 
of the meaning of a coefficient already computed. It is true that 
objection has been made to this method of interpretation in 
certain cases, ^ but it does not appear to the writer that this 
objection is justified. The reader who is interested in further 
discussion of this method of interpretation is referred to Thorn- 
dike,* Garrett,* and Nygaard ^ 

In this connection it should be emphasized that not only does 
a coefficient, even a high one, offer no proof at all that one of the 
two variables causes or directly affects the majpiitude of the 
other, but also it does not justify the conclusion that some cause 
or set of causes operates directly on both The only conclusion 
justified by the coefficient itself is that if it is possible to trace 
causal mfluences far enough back, enough of them will be found 
to account for the degree of relationship mdicated by the 
coefficient. 

Interpretation through approach to or departure from perfect 
correlation. For many purposes, especially for dealing with 
situations m which correlation is involved m the accuracy of 
estimation or prediction, the writer has found that the inter- 
pretation of coefficients of correlation by their departure from 
or approach to perfect correlation is very helpful Although a 
complete discussion of this method of interpretation involves 
certain pomts considered in later chapters, enough will be given 
here to indicate how to apply it Approach to fx*rfect correlation 
is commonly measured by the coefficient of correlation, r, or by 

‘ Chester A. Gregory and Omer W Renfrew, Slalistiral Mellwd tn Edit- 
eatum and Psychology (Cincinnati, C A Gregory Co , pp 156-159 

•Edward L. Thorndike, “The Constriction and Interpretation of Cor- 
relation Tables,” Journal of Educational Resiarch, Vol 7, March, 1923, 
pp. 199-212. 

* Henry E Garrett, Staiuhes in Psychology ami Education {New York, 
Longmans, Green & Co , 192r>), pj> 291-298 

'PH Nygaard, “Interpretation of Correlation on the Basis of Com- 
mon Elements,” Journal of Educational Psychology, Vol. 23, November, 
1932, pp. 578-683. 
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E, a measure which will be explained in the next few paragraphs. 
Departure from perfect correlation is usually measured by 
means of the coefficient of alienation, which may be defined as a 
measure of the element of error mvolved in estimating one series 
of measurements from another. The coeffieient of ahenation is 
abbreviated by k and is given by the formula v^l — r*. An 
examination of the formula makes it evident that the coefficient 
of alienation vanes inversely to r, equalmg zero when r equals 
± 1.00, and increasing as r decreases, until it equals 1 00 when r 
equals .00. 

The process may be earned still a step further, and instead of 
finding k, the departure from perfect correlation or element of 
uncertainty, one may find the approach to perfect correlation or 
element of certainty, E, referred to above, by the formula 
£=1 — l:orl — Vl — r^. E is also knowm as the coefficient of 
dependability. 

Another sjunbol almost synonymous with E has been used 
by some workers It is 1^, for inde.x of prediction, and is equal 
to 100£or 100(1 - k). 

It may not bi' clear to the reader just what is meant by an 
element of error, or of certainty, of a given amount. In general 
there are two bas(‘s of interpretation, one of which is the one 
just given It IS the more common of the two, but has often 
bc'en employed and interiireted erroneously. The absence of any 
relationship between two series of scorns is, of course, represented 
by a value of r of (X) If thi-^ value is substituted in the regression 
equation * presented ui a later chapter, the result is that all 
values of the variable Iwing estimated are estimated as being 
at its mean E or shows the improvement m efficiency or 
accuracy of prediction oi er such a situation. To state the same 
thing in another way, the \aluc of E ov I p for a given situation 
shows how much less the errors in the predictions are than they 
would be if r = .00 and all values were predicted at the mean. 

There is, however, another possible situation that may be 

•The r^resBion equation, which wall be explaineil lu Chapter XIII, is 
the beet and most generally used means of makmg such predictions or 
estimates as are in question here 



194 


STATISTICAL METHOD IN EDUCATION 


considered to be that of minimum forecasting efficiency and 
hence taken as the basis of comparison. To illustrate it, let us 
suppose that someone wishes to predict the semester mark 
made by each individual m a class, and that he knows the names 
of the pupils and the distnbution of semester marks, but has no 
information that helps him to connect a given mark with a given 
name. If under those conditions he estimates the mark of each 
pupil his estimates are subject to the same degree of error as if 
names were put in one hat., marks in another, and the two 
paired by chance drawings Both situations involve complete 
uncertainty or no degree of improvement over pure chance and 
r, of course, = .00. Such ('stimates are more in error than if 
the mean were used as described m thi* preceding paragraph, 
therefore the improvement oier this situation associated with 
a coefficient of correlation of a given value, e.xcept ±1 00, is 
greater than that over thi' u.si' of the mean Either methixl of 
interpretation is correct, but they should not be confut'd as has 
too often been the case For this second metliod the reduction 
of error over that of pure chance associated with values of r is 


given by the formula 1 — 



which may bt‘ changed to 


1 — .7071^. No symbol has come into general use for this, so the 
writer suggests that it be denoted by or 1,,^ and that for 
1 — A: the symbol Em or be employed. For the expression 



which equals 7071fc, he suggests the symbol 


9 


By 


substitution, it iS easily seen that E, = .2929 + .7071£'„ and 


Em = 1 4142.F„ - .4142. 

To aid in the interpretation of coefficients of correlation by 
the methods just described, d'able XLVI is inserted It. contains 
a number of values of the coefficient, wut h corresponding values 
of k, Em, g, and Eg. This table shows that, if r = 1 00, both 
k and g = .00 and both Em and = 1 00 , if r = .99, then 
A: = .14, £„ = .86, g — 10, and Eg = .90, and so on for other 
values of r. The outstanding fact evident from the table is that 
when r is large small decreases in it are accompanied by large 
increasf's in k and g and large decreases in both E’e, whereas 
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TABLE XLVI 

Valotb of k, E„, g, and E, Corsespondino to Given 
Values of r 


r 

k 


9 

E, 

1.00 

00 

100 

00 

100 

.99 

14 

86 

10 

90 

98 

20 

80 

14 

86 

97 

24 

76 

17 

83 

96 

28 

.72 

20 

80 


31 

69 

22 

78 

.94 

34 

66 

24 

76 

93 

37 

63 

26 

74 

.92 

39 

61 

28 

72 

.91 

41 

.59 

29 

71 

.90 

44 

56 

31 

69 

.85 

53 

47 

37 

.63 

.80 

60 

40 

42 

58 

.75 

66 

.34 

47 

.53 

70 

71 

29 

50 

50 

65 

76 

24 

54 

.46 

60 

8t) 

20 

57 

.43 

.55 

84 

16 

.59 

41 

.50 

87 

13 

61 

39 

40 

92 

08 

65 

35 

30 

95 

05 

67 

33 

20 

98 

02 

69 

.31 

10 

99 

.01 

70 

30 

00 

1 00 

00 

71 

29 


large changes m r when it is small are accompanied by small 
changes m the othi'rs To one who is accustomed to thmkmg of 
coefficients of correlation of 90, for example, as relatively high, 
and mdeod almost perfect, it is quite illuminating to reabze that 
the clement of dependability m a prediction based upon such a 
coefficient is only 56 or 69 

This method of mtiTpreting the value of the coefficient of 
correlation makes it very evident that for closeness of relation- 
ship or accuracy of estimate to approximate perfection the 
coefficient of correlation must be very dost* to 1.00. Also, since 
the formulse for k, g, and both E’s contain it shows that 
whether the value of r is positive or negative makes no difference 
in the closeness of the relationship, but merely m its direction. 
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In other words, if r = + .70, for example, the degree of relation- 
ship IS exactly the same as if r = — .70, but in the first case the 
two variables tend to increase and decrease simultaneously, 
whereas in the second as one increases the other tends to de- 
crease, and vice versa. 

If, instead of predicting one actual or fallible measure from 
another, a true measure is taken a.s the criterion, the formulse 
given above become, using the subscript 0 for the ciiterion: 

— \/ Too r^i ^ V^^oo ^01 

g. = = 

■v/ 1 + hm " X/I + ro(, 

In connection with the interpretation of coefficients of cor- 
relation through their approach to perfect correlation one fact 
not so far mentioned is frequently quite significant This is 
that the* correlation between two series of data cannot, except 
by chance, be higher than t he square root of the correlation of 
one of them with a duplicate senes of measures of the same 
thing. Because of this, a correlation coefficient involving a senes 
of data not perfectly accurate or reliable mdicates a higher 
degree of correlation between the two variables concerned than 
appears on the surface. To aid m interpreting such situations 
Huffaker* has suggested the following formula which gives the 
fraction of the departure from pi^rfect correlation due to the 
inaccuracy of one senes of niea.sures 

Vl — — V eil - rf; friz — Vui — 

-\/l — Ty. frl2 

In this formula the subscript 12 refers to two different series 
of measures and 1/ to two senes of measures of one of the 
variables. For example, if the coefficient of correlation between 
two senes of variables is 80 and one of them correlates .90 with 
a duplicate measure of the same thing, the formula gives 

Vl. - .80' - V90 - .80* 

' ■ :::: — lO 

Vl. - .80* 

•C. L. Huffaker, “Predictive Significance of the Correlation Coeffi- 
cient£.’ Journal of Educational Research, Vol 21, Januarj, 1930, pp. 46-48. 
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which means that 15 per cent of the departure from perfect 
correlation is due to the inaccuracy of the measures of the one 
variable and of course the remaming 85 per cent of it is due to the 
failure of the two variables to correlate perfectly plus the in- 
accuracy of the measure's of the other. Thus, since for r — .80 
k, the total appan'ut departure from perfe'ct correlation, = 
80^ = .60, 85 X 60 or .51 is the di'parture from perfect 
correlation Ix-tween accurate measures of one vanable and 
actual ones of the other. 

Interpretation through coefficients of determination and 
non-determination. Although the use of k and E„ or of g and 
Eg is quite common it is not universally applicable, and in some 
instances leads to conclusions that are not justified The most 
common and probably the most useful variation from it is to 
employ r^, called the coefficient of determination, and k^, the 
coefficient of non-del ermmation, rather than r and k, £„ and 
k, or Eg and g Since k = VI — r^, = 1 00, or, in other 

words, the sum of k- and represents the total situation just as 
does the sum of k and Em or of g and Eg. 

The type of situation in which it is legitimate to apply the 
method of interpretation just given is that m which a vanable 
18 associated with all of another variable plus one or more other 
factors This means that, if X and }' are tlu* two variables 
correlated, one of tlifiu, let us say X, is detennmed by all of F 
plus some other variable or variables not directly taken mto 
account in the computation of the cormlation In such cases r*, 
the coefficient of deti'raiination, represents the proportion or 
per cent of the variance in A' associated with Y, and k^, the 
coefficient of non-detennination, the proportion associated with 
the other factor or factors not included m T Thus, a coefficient 
of correlation bi'twt'cn A and Y of 90, for e.\ample, indicates that 
81 per cent of the elements or factors that determine X are 
associated with Y and that 19 per cent of them are not associated 
with Y. 

If one variable is associated with only a part rather than with 
all of another variable, plus certain other factors, that ia,i^ the 
two variables have one or more common factors that idKaot 
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include all of either of them, the degree of determination of one 
by the other is expressed by the square of the coefficient of cor- 
relation between them divided by the square of the coefficient of 
correlation between the common factor or factors and the second 
variable. Thus, if the two variables are X and Y and the com- 
mon factor or factors C, the degree of determination of X by F 
is given by 



9 * * 

The degree of non-detcrmination in this situation ‘“is then 1 

fiy 

In this connection it may Ix' notwl that if — C, Y — C, and C 
are uncorrelated with one another, r,„ 

There is a rather simple relationship existing between co- 
efficients of determination and non-det(*nninati()n and the 
standard deviations of the variables concerned, which it is 
sometimes helpful to know. If cri is used to represent the stand- 
ard deviation of the port ion of variable X that is related to Y 
and (Tj, for that of the portion of variable X that is not related to 
Y, the standard deviation of A' is related to the other two by 

the equation (Tr = Vo'f -|- <r| Moreover, = — and . 

Thus if the three standard deviations involved are known it is 
easy to find the values of r and k and accordingly of and ifc* 
without making the complete computation for the coefficient of 
correlation between the two variables. 

For further discussion of coefficients of detennination and 
non-determination and closely related matters pertaining to 
the interpretation of coefficients of correlation the reader is 

“ The two fonnulffi Riven here are more general than those in the pre- 
ceding paragraphs, which are for the s[)ectal ease resulting when C =• K, 
that IB, when the common factor includes all of Y then =» 1,00, whence 

the coefficient of determination = - — tJ^, and correspondingly that 

of non-detenmnatioD - 1 — ” 1 “ - k^. 
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advised to see Ezekiel,” Tryon,” who gives a method for deter- 
mioing the value of and also a chart to aid in interpreting r 
when the condition that obtains vanes more or less from that in 
which it IS appropriate to use r* and k^, and Dunlap and Cure- 
ton. 

The method of interpreting correlation by means of co- 
efficients of determination and non-determination may be 
applied not only to ordinary or zero-order coefficients of cor- 
relation but al-so to those of partial, part, semi-partial, and mul- 
tiple correlation, which are discussed m Chapters XVT and 
XVH. Coefficients of detennination and non-defermmation, 
however, will not Im' mentioned again in these chapters, smoe 
their application to such coefficients is essentially the same as to 
those di'alt with hiTe 

Effect of spread of data upon value of r. The interpretation 
of the coc'fficient of correlation also depends upon certain facts 
concerning the data for which it is computed One of these 
facts that should be known is the spread of the data, that is, 
the extent to which they vary' or scatter away from their aver- 
age. Probably the most common occlusion on which this is 
important is when then* is a difference in the number of school 
grades from which the data for the two or more correlations 
being compared were ^ecu^ed. Ctx'fficients of correlation are 
frequently determined between senes of measurements ob- 
tained from a single grade, when>as at othcT times they are 
basi'd upon those from seieral grades. In many cases the 
spread of the characteristic nieasunHl increases as the number 
of grades is increased. For example, the l ariations in height, 
weight, nuuital age, score u|X)n a subjeci-miitter test, etc., 
may be expected to bo greater in two grades than in one, greater 
in three than m two, and so on The effect of this increased 

1* Mordecai Ezekiel, Methoils nf Cirrreiatwn Anaiysjs (New York, John 
Wdey & Sons, 1930), pp 120, 375-383 

** Robert Choate Tryon, “The Interpretation of the Correlation Co- 
efficient,” Psychological liencu', Vol 36, September, 1929, pp 419-445. 

*• Jack W Dunlap and Eklward E Cureton, "On the .\naly8is of Causa- 
tion," Journal of Educalional Psychology, Vol 21, December, 1930, pp. 
667-68t). 
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spread is to raise the obtained value of the coeflBcient of corre- 
lation even though the actual amount of relationship is not 
changed. 

Sometimes the effect of increasing the spread is so pronounced 
that correlations that are negative for a smgle grade or other 
limited group become positive for a more scattered or variable 
group. One of the common examples of this is the correlation 
between chronological and mental age Within any given grade 
it is almost always true that the younger pupils are brighter 
and the older ones duller, so that the correlation between men- 
tal and chronological age m a smgle grade is usually negative, 
generally from —.20 to — 50 If two or three grades are taken 
together this correlation change.s to about zero, whereas if five 
or six are mcluded it becomes jwsitive, probably from +.50 
to +.70, agreemg with the fact that oldi^r children tend to 
have higher mental ages than younger ones. 

It should be noted that one group may have a greater spread 
than another in some characteristic or characteristics other 
than those correlated without affecting the value of r. If the 
mean values of the two vanable.s dealt with in the different 
situations and also their variabilities are the same or approxi- 
mately the same, coefficients of correlation may be compared 
with one another directly Such a condition commonly e.xists, 
for example, m the cases of intelligence quotients, school marks, 
and health ratings. Ordinarily the mean value of each and also 
its spread or variability is practically the same m one grade 
as in a number of grades combined. Thenffore the correlation 
between I Q.’s and school marks, for instance, for a group from 
several grades is generally practically the same as for a smgle 
grade group. However, it may be that there is a difference in 
the spread of these characteristics due to some less common 
basis of grouping than grades. If, for example, pupils have been 
grouped according to their mental ability, the spread of I. Q.’s 
will be greater in a combined group embracing sectionl|||f vari- 
ous abilities than in a smgle group of bright, average, w dull 
pupils 

Conversely, the general principle may be stated that if the 
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data for heterogeneous groups which m themselves show no 
correlation are combined, the total group will show correlation 
unless the mean value of at least one of the two variables is 
the same for all the original groups. 

It IS possible to render comparable coefficients of correlation 
obtained from groups with different spreads by means of a 
formula which makes allowance for these differences Formula 
for this purpose have been given by Otis “ and Kelley “ The 
most common case in which such a formula is useful is m a 
comparison of coefficients of ridiability obtained from adminis- 
tering tests to groups covering different ranges of ability. The 
geni'ral formula for the relationship between ranges of true 
abihty and reliability coefficients is 


a\ ^ Vri(l - T-^ 

Vr.fl — ri) 

m which the ir’s are those of true measures and the r’s relia- 
bility coefficients The subscript 1 is used for those measures 
secured from testing throughout one range of ability, and the 
subscnpt 2 for those secured from testing throughout another. 
Solvmg the fonnula just given for r, we have 

ri = 4 — ; — s- and 

- ri) + (j\Ti 


o Arthur S Otis, “The Reliability of Spelling Scales, Involving a ‘Devia- 
tion Formula’ for Correlation,'' Schmtl and Soiiety, Vol 4, October 28, 
November 1, 11, 18, 1910, pp 070-683, 716-722, 7ol>-756, 793-796. 

, “A Method of Inferring the Clmnge in a Coefficient of Correla- 
tion Resulting from a Change in the Heterogeneity of the Group,” Journal 
of Educatumal Psyclu>h>qy, \ ol 13, May , 1922, pp 293-294. 

and Herliert E Knollin, “'The Reliaiiiliti of the Binet Scale 

and of Pedagogical Scaleb,’’ Journal of Educational Research, Vol. 4, Sep- 
tember, 1921, pp 121-142 

“ Truman L Kelley, The Reliability of Test Scores,’’ Journal of Edur 
eaiicmEAMesearch, Vol. 3, May, 1921, pp 370-379 

—mtf^SUdisliaii Method (New York, Macmillan Co , 1923), pp 221- 

228 . T 

, “Measures of Correlation Determined from Groups of Varymg 

Homogeneity,” Journal of the American Statistical AssodOtion, Vol. 20, 
December, 1925, pp 512-521 
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o|ri 

<r5(l - ri) + 

If instead of ranges of true measures, which are rare, those of 
actually obtained measures are m question, the general formula 
becomes 

ffl _ 

\/l — ri 

and those for the two r’s, 

2 

r, = 1 — ^11 — rj) and 
n = I - '^1(1 - Ti) 

(Ti 

The application of these latter formulae may be illustrated 
by the following example. Let us suppose that the reliability 
coefficient of a test when given to a relatively restricted group 
of pupils IS .60, and when given to a group covering a much 
wider range, .90, that the standard deviation of the scores of 
the first group is 10, and that of the second group, 20 In this 
connection it should be noted that since, in determining the 
reliability of a test, two admini.strations of the same test or 
of duphcate forms thereof are involved, it is assumed that the 
standard deviations of the two administrations or forms of the 
same test are equal. If they are not their average should be 
used in the formula. The question to be determined is which 
coefficient of rehability really represents the higher reliability 
in view of the difference m ranges If we consider the subscript 
1 as applying to the smaller coefficient and standard deviation 
and 2 to the larger ones and solve for the value of ri correspond- 
ing to the obtained value of rj, we have 

ri = 1 = •«> 

Since this IS the same as the actually obtained value of ri, 
it shows that the two sets of data indicate equal reliability 
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for the test. The same conclusion is also arrived at by solving 

10 ® 

for rj instead of r\, since rj = 1— ^ (1 — .60) = .90, again the 

same as was actually obtained. 

In case the two variables dealt with are not similar, the 
formal® to be used are somewhat different. The general 
formula for such a situation in which the range of one vari- 
able has been curtailed, but not that of the other, is a\k\ = ffjct, 
m which the o’s used are those of the variable whose range 
is not curtailed Substituting for k its value in terms 

of r and solving, we obtain r, = — ff|(l — r|) and 

O’ I 

rj = Vo"! — If, instead, it i.s desired to have the 

O’ 2 

fonnula m terms of thi* .standard deviation of the measure 
that 18 curtailed, it becomes r— = whence we obtam 

«20-2 KlO-l 


r\ 


OlTl 

\/cr\{l - il) + <7-fr| 


and 


02ri 

- rf) -I- a\r\ 

In deriving these fomuil® it has been assumed that the distri- 
bution in the curtaih'd trait is rectilinear and homoscedastic, 
that IS, has arrays of <>qual variability. 

If there has Uam sidection in both variables so that both are 
directly curtailed, the eonection of one coefficient of correla- 
tion to render it comparable with the other requires the use of 
a more difficult formula gii en by Kelley. 

Some objection has been raised to the use of this formula 
and Dickey has projiosi'd another in its place, but at least 
some of the points raised have been nduted and an empirical 
tryout of the two formula' by the present wrib'r has shown that 

'• JAn 'W. Dickey^ '‘On Estimating the Reliability Coefficient,” Jour- 
nal Applied Peychologj/, V^ol 18. Februarv, 1934, pp 103-115 

” ‘‘On the Assumption That Errors of Estimate .Are Equal in Narrow 
and Wide Ranges,” Journal of Educational Research, 'V'ol. 4, October, 
1921, pp 237-239 
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the results from that of Kelley are slightly closer to the actual 
ones than are those from the formula given by Dickey. 

Interpretation in terms of displacement. Another means of 
interpreting the coefficient of correlation is in terms of dis- 
placement, that is, of the differences m the positions of the 
measures in one series from those of the corresponding measures 
m the other. It is possible to make such an interpretation in 
terms of any desired amount, that, i.s, each senes may be divided 
into halves, thirds, fourths, fifths, tenths, or any other desired 
fractions, and a detennination made of how great the displace- 
ment or shift between corresponding measures is. Also, in- 
stead of expressing this displacement in terms of fractions of 
the distnbution, it may be stated in terms of measures of vana- 
bility such as the median or standard deviation Perhaps the 
most common means of expressing it is in terms of the former. 
Therefore Table XLVII, which shows such displacement, has 
been prepared. This table, which is a modification and ex- 
tension of one given by Otis,” shows for each of a number of 
values of the coefficient ranging from 1 00 down to 00 the 
corresponding per cents of cases who.se positions in the two 
series correlated differ by the given numbers of median devia- 
tions. For example, if r = .50, 26 per cent of the cases fall 
within corresponding divisions whose width is one median 
deviation, 43 per cent fall within such divisions whose positions 
differ by one median deviation, 22 per cent within such divi- 
sions whose positions differ by two median deviations, and so 
on. The per cent of casi's falling within not more than any 
given number of median deviations of the same position in the 
two distributions may be found by summing the entries in the 
appropnate row of the table up to the column corresponding 
to the given number of median deviations. Thus the per cent 
of cases occupying positions in the two distributions not more 
than three median deviations apart for a value of r = 50 is 
found by adding 26, 43, 22, and 7, which gives 98 per cent. 

The entries in this table were computed m the following 

“ Arthur 8 Otis, Statutical MelhoJ in Edwaiwnal Measwremenl (Yon- 
kere-on-Hudson, World Book Co , 1925), p 225. 
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TABLE XLVII 

Per Cents of Cases Displaced in Terms op Median Deviations 
Corresponding to Given Valdes op the Coepficibnt op 
Correlation 


r 

Median Devialions 

0 

I 

I ^ 

3 

4 

5 

6 

7 

1 00 

UK) 








.99 

98 

2 







.98 

91 








97 

83 

17 







.96 

77 

i 







.95 

71 

29 

1- 





1 

.90 

S-J i 

43 

20 






.80 

41 

48 

10 

8- 





70 

34 

47 

10 

28 

2- 




60 

29 

40 

20 

5 2 

7 

1- 



50 

20 

43 

; 22 

7 

1 7 

2- 



.40 

21 

40 

i 24 

9 

26 

5 

1- 


30 

22 

39 

21 

10 

30 

8 

2- 


.20 

21 

37 

24 

12 

46 

1 2 

3 

1- 

10 

20 

35 

24 

13 

6 

1 8 

5 

.1- 

00 

19 

31 

21 

13 

7 

2 4 

6 

.2- 


manner as will be found in Chapter XX, the error-of-estimate 
formula for two correlated series of aetual scores is ay/2 — 2r, 
whence that for thi' probable error of estimate or median de- 
viation of displacement is 6745(r\/2 — 2r, or MdDy/2 — 2r. 

From this, MdD = By substitutmg m this the de- 

v''2 — 2r 

sired value of r and hMdD^^p, \.bMdDi^, 2 5MdD ^,^ , and so 
forth, and finding the area under the normal curv’e withm the 
limits of the values of the median deviation, the results given 
in the table were obtained The same procedure can be applied 
and appropriate tables constructed for other situations such 
as the correlation between actual and estimated scores, actual 
and theoretically true scori's, etc., by employing the proper 
formula for the given case instead of a\/2^ — 2r. Also by the 
proper change such tabh's can, if desired, be made out in terms 
of the standard, mean, or some other deviation instead of the 
median deviation. The latter is convenient to use, however, 
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because a range of lOMdD includes practically all the cases in 
a normal distribution unless N is quite large. 

Correction for small numbei^ of cases. In addition to in- 
terpreting the reliabihty of coefficients of correlation through 
the measures suggested m Chapter XIX, there is an additional 
method of interpretation from a more-or-lcss similar stand- 
point, which it seems well to mention here. A coefficient of 
correlation obtained from a comparatively small number of 
cases may ordinarily be takim a.s the most probable' value of 
the true coefficient for the actual cases concerned, but when 
considered as the most likely \alue for the total population of 
similar cases it is desirable' to adjust it by applying a correction. 
The formula is as follows 

rco. = y 1 - (1 - 

For example, if a coefficient of correlation of 60 has been se- 
cured for twenty cases the mo.«t likely value of r for the total 
universe from which this small sample is drawn is given by 

|/l - (1 - 

which gives .57. It can be seen from the formula that the cor- 
rected coefficient will always, as in the example just given, be 
less than the actually obt aim'd one. This correction formula 
with a graph by which adjusted coefficients may be obtamed 
without computation may be found in Ezekiel 

Spurious correlation. If coefficients of correlation are com- 
puted for heterogeneous mati'nal, an element of spurious cor- 
relation is frequently introduced. Ordinarily this is caused by 
the effect of some irrelevant factor upon the two vanables 
being correlated. For example, if the scores on an intelligence 
test that includes an arithmetic test as one of its parts are 
correlated with those on the arithmetic test alone, the fact 
that the latter form a part of the former wull result in the appeare 

" Mordecai Ezekiel, Methods of Corrdatum Analysvs (New York, John 
Wiley (Sr Sons, 1930), pp 121-124, 397-.398. 
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ance of a certain amount of positive correlation that for many 
purposes at least may be considered as irrelevant or spurious. 
Its existence does not, of course, affect the fact that the obtained 
amount of correlation obtained between total scores on the 
test and those on the arithmetic part thereof exists, but it does 
affect its mterpri'tation The ordinary method of eliminating 
such undesired factors is by the method of partial correlation, 
which will b(' treat ('d later. However, it is freipiently possible 
for the worker in this field to obviate the necessity for comput- 
ing partial correlations by selecting and employing data that 
do not involve it relevant factors. For furthei discussion of 
spurious correlation and related matti'rs, the ri'ader is referred 
to Thomson and Fintner,"'’ Garrett,-* and Dunlap and Cure- 
ton 

Averaging coefficients of correlation. Before closing the dis- 
cussion of coefficients of correlation the caution should be 
dropped that it is iinsife to average them. For example, if the 
correlation hctwam two variabl<'.‘' is 40 in one case, .50 in a 
second, and .GO in a third, one should not conclude that if the 
three groups \%eie uniK-d it would be .50 Unless the means and 
standard de\iatiou-- of lUe different groups are the same, one 
is not justihed in averaging coefficients, and even then each 
must be weighted bv the iiumtHT of case.^ that contributed to 
it If one know.s th.it lh(> variouf< group.s are approximately 
homogeneous, howeter, and if they are weighted as just sug- 
gested, the error iinohed m ateraging is not likely to be very 
great Usually all the ubiained ccndheients should be given so 
as to show their range as well as their average 

Two general references. In eoncluding the discussion of the 
interpretation of the coeihcient of correlation, the writer wishes 

” GiHlfn'v 11 Thonibon iiiitl Riulolf Pmtner, “Siiunoiis Correlation 
and Relaluiiit-hip between Journal of Educational Psychology, 

Vol. 15, October, 1924, iip 4:53-1 It 

•* Henry E. Garrett, Statistics in Psychology and fidiirotion (New York, 
Longmans, Green & Co , 1926), pp 258-261 

** Jack W Dunlap and Eiiwiird E Cureton, “On the .•tnalvsis of Causa- 
tion,” Journal of Edueatumal Psychology, Vol 21, Decemlier, 1930, pp. 
667-680. 
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to mention two general references on this subject as worth the 
reader’s attention. One is by Monroe and Stuit,** to the first 
of whom he also wishes to acknowledge his indebtedness for 
the very considerable assistance from as yet unpublished mate- 
rial given him in connection with certain pomts dealt with m 
this chapter. The second, by Furfey and Daly,^^ is highly 
critical of some commonly accepted modes of interpretation. 

Exekoises 

1. What are the values of A, E„, g, Eg, r’, and for each of the 
following values of r? A, 87, B, 71. C, 54, D, 35 

2. Which one of each pau- of coefficients given below represents the 
doeer relationship‘s Both are of similar measures 

A. r = .80, ff’s = 2 and 2 2, or r = .95, a's = 5 and 4 8 

B. r = .40, (t's = 2.5 and 2 6, or r = 85, ct’s = 5.2 and 5.3. 

** WjJter S Monroe and Dewev B Stmt. “The Interjiretation of the 
Coefficient of Correlation,” Journal of Experimental Education, Vol 1, 
March, 1933, pp 186-203 

” Paul Hanly Furfey and Joseph F Daly, “The Interpretation of the 
Product-Moment Correlation Coefficient,” Catholic University of America 
Edvcattonal Research Monographs, Vol VIII, No. 4. Washington, Catholtc 
Education Press, June 1, 1934, 57 pp 
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THE COEFFICIENT OF RELIABILITY AND 
RELATED MATTERS 


The coefficient of reliability. The coefficient of reliability or 
of self-correlation is the coefficient of correlation between two 
applications of the same measuring instrument These two 
applications may be of exactly the same form, but are generally 
of two duplicate and equivalent forms, that is, forms similar 
in construction, b'ngth, difficulty, etc., but with different con- 
tent If a measuring instrument composed of a number of ele- 
ments has been used only once, a reliability coefficient may be 
obtained by correlating scores from alternate elements In 
other words, items number 1, 3, 5, 7, and so on, are considered 
as forming one test, and items 2, 4, 6, 8, and so on, as forming 
another, and the resulting two sets of scores correlated. This 
method is prefeiable to giving the same form twice, but the 
result obtained is thi' coefhcient of reliability of one-half of the 
test, not of the w hole test 

Although in almo>t all cases the coefficient of reliability is 
most easily found by securing the coefficient of correlation 
between the two si'ru's of scores in question, it is occasionally 
convenient to employ another formula This is 


r (the coefficient of reliability) = 1 — 



or 


r = 1 — 



In this ffj.oo and PE^ « stand for the standard and probable 
errors of measurement, measures of reliability which will be 
explained in Chapter XX. 

The Brown or Spearman-Brown formula. WTiat is called the 
Brown or the Spearman-Brown formula deals with the relation- 

21)9 
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ship between the length of a test and its coefficient of reliability. 
It is usually given in the form 


nrii 

- 1 + (« - l)r„ ■ 


In this formula r„ is the coefficient of reliability that may be 
obtained by applying the test n times, and r,, is the coefficient 
from two applications Thuh if the coefficient of reliability from 
two applications of a niea'.tiiing insfninient is known, that 
which would probably result fi.nn anv givi'ii number of applica- 
tions or a given incu'ase in li-nuih ' can be detennmi'd For 
example, if the coefficient of releilnlity from two applications 
of a test IS 60 and ihi- test i^ gi\ I'n five timi's or mad(> five times 
as long, the coefficient of leliability of the lengthened test is 


5 X 60 
- 1 60 


88 


The most frequent application of this formula is to didemiine 
the rehabiliiy of the wholi' test m cases when the reliabiliiy has 
been determined as menliotii'd above, by correlating odd with 
even elements By substituting 2 for n in the formula it becomes 
2r 

n = - — Thus, if till' coeflicicnt of reliabilitv of one-half of a 

I + I'll 

test (that IS, the coefficient Ix'tween the odd and even element 
scores) is 60, for example, that for the whole test is equal to 

2_X 60 
I -{“ 6t) 

By solving for n the formul.i given above may be changed to a 
more convenient form for finding the increase in length or num- 
ber of apphcations necessary to secure a given degri'e of reliabil- 
ity. It becomes 

n = 

r„(i - r„) 

To illustrate its use suppose that a test has a reliability of .70 


= 75. 


* Theoretically there is no difTerence between refieating a test a certain 
number of times and giving a similar test whose length is the same num- 
ber of times that of the first. 
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and one of .90 is desired. Substituting in it, 


90(1 - .70) 
~ .70(1 - .90) 


3.86. 


This means that the test must be made 3.86 times as long, or 
applied almost four times, to secure the desired reliability of .90. 

If there are more than two duplicate forms of a test and results 
on all have been correlated with one another there is more than 
one coefficient of reliability. One is between Form 1 and Form 2, 
another between Forms 1 and 3, another between Forms 2 and 3, 
and so on. Theoretically these various coefficients should have 
the same value In practice, however, they rarely do, hence the 
question anses as to which one of them should be employed in 
the Speannan-Brown formula. The best practice is to employ 
their averap;e value, for which the gi'ometnc mean is probably 
the best, although the ordinaiy' mean is often used. 

The ordinary Spoaiman-Browm formula, the first one given 
in this section, a.ssunies that the intercorrelations among the 
tests which, whim combined, form the lengthened test, are 
equal. If, as may often b(‘ the ca.se, thosi' of single tests or forms 
with themselves are not the same as thosi* of forms or tests with 
other forms or tests, this formula is not highly accurate Hol- 
zinger ^ has suggested the following fonnula as apphcable to the 
latter situation 

- 'I'll — n(n — Dr'u 
71 + /i{n - l)r;, 


In this r,! refers to the correlations of single forms or tests with 
themselves and )(i to those with different fonns or tests. 

The validity of thi' Bjs'annan-BrovMi formula has been at- 
tacked, but the attack appears to have Ixam answered satis- 
factorily, provided th(« underlying assumptions are met. Of 
these the most important in actual practice is that the content of 
the various forms or tests concerned be truly homogeneous, 
particularly as to difficulty. The reader who is interested in 
further details of the controversy may find them by consulting 

’ Kwl J Holzinger, "The Reliability of a Single Test Item,” Journal 
o/ Bducaiwnal Psychology, Vol 23, September, 1932, pp. 411-417. 
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the references given below.’ Moreover, it has been shown by 
several investigators * that the formula applies to ratmgs of 
traits and to some other types of measurement at least approx- 
imately as well as to test scores. 

Variations of the Brown or Spearman-Brown formula. One 
of the underlying assumptions upon which the Spearman-Brown 
formula is based is that the various test units of the measuring 
instrument concerned are ail comparable and similar forms of the 
same test. It is, however, sometimes desirable to be able to 
estimate the coefficients of reliability of batteries of tests that 
are not composed of tests .similar and comparable to one another. 
Such situations do not occur freiiuently enough to seem worth- 
while discussing further here Instead, the reader who is in- 
terested is referred to a discussion thereof in an article by 
Douglass and Cozens.’ In gen(>ral the formula they propose 

•Karl J Holzmger, “An .Analysis of the Errors in Mental Measure- 
ment,” Journal of Educational Psychology, Vol 14, May, 1923, pp 278- 
288. 

and Blythe Clayton, “Further Experiments in the Application 

of Spearman’s Prophecy Formula,” Journal of Educational Psycholgy, Vol. 
16, May, 1925, pp 28<>-299 

Truman L. Kelley, "The Applicaliility of the Spearman-Brown Formula 
for the Measurement of Reliahilitv,’’ Journal of Educational Psychology, 
Vol 16, May, 1925, pp 300-303 

Giles M. Ruch, Luton Ackerson, and Jes.se D Jackson, “An Empirical 
Study of the Spearman-Brown t’oruiula as Applied to Educational Test 
Material,” Journal of Educational Psychology, Vol 17, Mav, 19‘26, pp. 
309-313 

C 8 Slocombe, “The Spearman Prophecy Formula,” Journal of Edu- 
cational Psychology, Vol 18, February, 1927, pp 12.5-126 

•Paul Hanly Furfey, “An Improved Rating-vScale Technique,” Journal 
of Educational Psychology, Vol 17, .January, 1926, pp 45-48 

Ben D Wood, “Studies of Achievement Tests,” Jourruil of Educational 
Psychology, Vol 17, April, 1926, pp 263-269 

H. H Remmers, N, W. Shock, and E L. Kelly, “An Empirical Study 
of the Validity of the Siiearmaii-Brown F’ormula an Apjihed to the Purdue 
Ratmg Scale,” Journal of Educational Psychology, Vol 18, March, 1927, 
pp. 187-195. 

Kate Gordon, “Group Judgments in the Field of Lifted Weight,” Jontr- 
nal of Experimental Psychology, Vol 7, October, 1924, pp 398-400 

•Harl R Douglass and Frederick W Cozens, “On Formula for Esti- 
mating the Reliability of Test Battenes,” Journal of Educational Psy- 
chology, Vol. 20, May, 1929, pp 369-377. 
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yields reliability coefficients for the complete measuring instru- 
ment somewhat less than would be obtained from the Spearman- 
Brown formula. 

The effect of increasing the length of a test not only upon its 
reliability but also upon its validity can be determined by means 
of a modification of the Spearman-Brown formula as follows: 




or 


nr, 2 


l)r 2 ii \/n + n(n — Ijr^n 


In this formula ri'preatmta the correlation between var 

liable 1 and n forms of variable 2 combined mto a single score; 
ris IS the average correlation of variable 1 with each form of 
variable 2, and r^n is the average reliability coefficient of the 
measures of variable 2 Thus, if the average correlation between 
the vanables is 50 and the average reliability coefficient of 
vanable 2 is 80, thi* correlation between variable 1 and the 
combined score on four forms of variable 2 is given by 


50 



4 

1 - 1 - (4 -■ 1 ) 80 


which equals 54 As has bi*en pointed out aptly by Paterson and 
others * m their discussion of this formula, although lengthenmg 
a test very frequently increases its coi'fficient of rehabihty so 
largely that it may approach 1 00, it usually has comparatively 
small effect in increasing the correlation between it and another 
test, that IS, its coefiicient of validity with respect to another 
test Moreover, the maximum possible l alue of the validity 
coefficient is limited by that of the reliability coefficient. It 

r 12 

cannot, exceed the value given by the fraction -j-— which is 

vr»ii 

obtained by putting n I'qual to infinity in the equation given 
above. Thus, in the case just used its maximum possible value is 
.50 

.56 If both tests are lengthened the correlation between 


'Donald G Paterson and others, Mxnnesota Mechantcal Ability Teita 
(Minneapolis, The University of Minnesota Press, 1930), pp. 373-375. 
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their lengthened forms is 


>’(ni)(nS) = 


ninjTi* 


Vtm + ni{n\ — l)rii][na + n*(n* — l)r 4 ii] 


Y [I + (ni — l)rii]ll + {nt — l)rjii] 

It is also possible to estimate the effect of an increase m its 
reliability upon the validity coefficient of a test. The following 
formula shows this relationship 

Jiii — 


In this Ru and Rm refer to the increased coefficients of validity 
and reliability, respectively Thus if a test has a coefficient of 
validity of .60 and of reliability of 75, and the latter is increased 
to .90, the coefficient of validity becomes 

The formula given above for ri(„j) may be solved for n, giving 


1 - rjii 


rnn8)(l 


or — 

^12 ~ ^211 r,(„j) 


and enabhng one to detennine the change in the length of a test 
necessary to secure a desired validity coefficient Thus, if that 
of the single test is .65, the reliabihty coefficient .80, and a valid- 

.70-(l - 80) 

ity coefficient of .70 is desired, n = _ gQ ^ 3.21, 

thus showing that the test must be made about three and one- 
fifth times as long, or repeated that many times, to secure a 
coefficient of validity of 70 If the desired validity coefficient is 
very much greater than that actually obtained the formula is 
liable to give a negative result. This mdicates an impossible 
condition, that is, that the coefficient of validity cannot be 
increased as much as is desired by merely increasing the reliabil- 
ity. 
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The index of reliability. If a measimng instrument were per- 
fectly reliable and were used by competent persons, and if 
conditions at the time of measuring were identical, its coefficient 
of reliability would be 1 00. When, a.s always, this ls not the 
case, it 18 liki'ly that there are errors in both sets of measures 
rather than that all ar(‘ in one. Therefoie the coefficient of 
reliability is lowered by the pn*sence of these two sets of errors, 
one in each senes In a single senes of measures only one set of 
errors is pri'sent, and the correlation betwian tins single series 
of obtained measures and the theoretically true scores is lowered 
less by this single sr'l of (-rrors than is the correlation m the 
previous case by the two sets The coefiicient of correlation 
between a set of theoretically tnu* scores and one of obtained 
scores is called the uuiev of reliability and is eciual to the square 
root of lh(' coeflieient of reliability It is therefore always larger 
than the latter unless both eciual 1 00 or 00 

The th('oretically true scon* referred to above may be defined 
as the mean of an intinite number of obtained scores that have 
been corrected foi any practice effect or constant or systematic 
error’' It cannot actuallv be obtained From a practical stand- 
point, howe\er, one inav think of it as the mean of as many 
obtained scores as are a\ ailable. 

Attenuation and its correction. It was stated in the preceding 
chapter that the effect of chance errors in the measures involved 
in correlation is to reduce the value of the coefficient of correla- 
tion so that the actually obtained value is less than the true value. 
This reduction is known as alien uation Ordinarily it cannot be 
eliminated by increiusing the number of caM-s upon which the 
coefficient is basi'd. To (hderinine the tnie coefficient of cor- 
relation one may ('iiiploy the proper one of several fonnulse, 
which wall lie presimted in this section. 

Bc-fore proceeding to di.-'CUss com^ction for attenuation, how- 
ever, it may be well to explain why the effect of variable errors 
is to lower the obtained coe'fticient of correlation. To illustrate 
this the example in Table XLVIII may be used. In this table X 

’ The meaning of a constant or systematic error is explained m the 
discussion of unreliability m Chapter XIX. 
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TABLE XLVIII 


Illvbtbation or the Effect of Variable Errors in Reducing or 
Attenuating the Coefficient of Correlation 


X 

r 

ex 

ey 

A" 

Y' 


20 

-1 

-1 

i 9 

19 

9 

18 


-1 

10 

17 

8 

16 


-3 


13 

7 

14 1 


+ 1 

5 

16 

ft 

12 


+2 

8 

14 

5 


-1 

+3 ! 

4 

13 

4 

8 

-3 

— 2 ! 

1 

6 

3 

6 

+3 ; 

+2 

f> 

8 

2 

4 


-2 ' 

3 

2 

1 

2 

— 2 


-1 

3 

f 3* 


1 

r = 

79 


and Y represent two seru‘s of data bt'tween which perfect cor- 
relation exists The Cx and columns contain errors distributed 
by pure chance among t he ton measures of each siTies. In each 
series is one error of -|-3 and one of —3, two of -|-2 and two of 
—2, two of -fl and two of —I. When the errors are added to 
the onginal measures the results arc the entries found in the 
X' and Y' columns. Thus these entries correspond to the actual 
measures that would bi' obtained if there were perfect correlation 
between two series of true measures, but if the actually obtained 
measures were subject to chance errors such as are given in the 
ex and Cy columns An insp(>ction of the X' and Y' columns 
indicates that although there is fairly high corndation IxAween 
them it is not perfect. By computation tht* coefficient of cor- 
relation for these two senes is found to be .79, thus showing a 
decrease of .21 from the correlation of 1 00, which indicates the 
true relationship between the characteristics measured. 

In order to correct for attenuation it is necessary to have two 
senes of measures of each of the two variables or to know the 
coefficients of rehability of the measures of the vanables as well 
as the coefficient of correlation between them. For example, if 
pupils’ heights and weights are being correlated there must be 
two measures of height and two of weight for each pupil, or the 
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reliabilities of the measures must already be known. Since two 
senes of measures or reliability coefficients are not always 
available, correction for attenuation cannot always be made. 

The general form of the formula for correction is a fraction 
in which the numerator represents correlation between one 
variable and the other, and the denominator correlation between 
the similar series of measures, that is, reliabihty Letting X and 
Y represent the two variables, and the subscripts 1 and 2 the 
two senes of measures of each, and when, as usually, chance 
errors exist in the case of both variables, the simplest form of the 
formula for correcting for attenuation is 


true Tr 


x/r j I r„ „ 

1 J "I'a 


There are, however, four possible ways of computing the term 
used m the nuiruTator, that is, the correlation between X and Y. 
These may be n'presented by the symbols r,,,,, and 

That is, the first si'ries of X measures may be correlated 
with either series of >' measures, and, likewise, the second 
senes of X measures with {-ither one of t he 1’ measures. Probably 
the best usage is to employ for the numerator the geometnc 
mean of the four coefficients, which gives 




true r„ = 


but almost as good results are obtained by the somewhat easiw 
formula: 


true Try = 



V 


Expressmg this in words, the tnie coefficient of correlation 
between X and Y is found by taking the square root of a fraction 
whose numerator is the product of the coefficient of correlation 
of the first senes of X measures with the second series of Y 
measures times the coefficient of the second senes of X measures 
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with the first series of Y measures, and whose denominator is 
the product of the coefficients of reliability of the two senes of 
measures. 

In employing any form of the formula for attenuation one 
should obtain the coefficients used in both numerator and 
denominator from the same siTies of data. If these are not 
available, coefficients from senes having equal ranges may be 
used. 

To illustrate the application of (he last fomnila given above 
let us suppose that the same jiupils hav(‘ Ixam given two spelling 
tests and two reading tests, and it is di'sired to find the true 
coefficient of correlation between scores thereon Fiirthemiore, 
let us suppose that thi' first senes of spidling scores and the 
second of reading scores correlati 50, thi' si'cond of spelling 
scores and the first of reading scores, 40. the two senes of spell- 
ing'Seores, 70, and the two s(>iies of reading scores, 80 The 
coefficient of correlation collected for attenuation is then 



50 X 40 
70 X SO 


()0 


It happens occasionally that one wislies to correct for attenua- 
tion in cases in which one senes of me.asureinents is perfectly 
rehable, that is, contains no l anabh' errors In such casi's one 
of the reliability coefficients is l OO and need not tie expressed; 
therefore the denominator contains only one coefficient, that 
between the two senes of mtaisures of the variable that has the 
errors. Since the two senes of measures of the otlicr vanablc 
will be the same if there are no errors m it, it is not neces.sary 
to obtain both, and accordingly the subscripts 1 and 2 arc not 
employed for that variable If the X measures are a.Shumed to 
contain no errors, the fonnula becomes 

♦ i "'■'i 

true = A/ — ‘ • 

* W, 


To illustrate this suppxise that perfectly accurate measures of 
chronological age have been correlated with scores on two forms 
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of an intelligence test. If the correlation between age and score 
on one form is .85 and that between age and score on the other 
form .88, an d if the co efficient of rehabihty of the test is .92, 

true r = ^ which equals .90. 

It may be seen by mspectmg the formulae in this section that 
the higher the coefficients of reliability, the smaller the amount 
by which the obtained coefficient of correlation is increased by 
correctmg for attenuation. If the measures of both variables 
are perfectly reliable, the corrected or true coefficient of cor- 
relation IS exactly the same as that actually obtained, smce no 
attenuation is present m the latter. 

Attention should also be called to the fact that occasionally 
the application of this formula yields a value for the true co- 
efficient of correlation greater than 1 00. This occurs when the 
correlation between the measures of one vanable and those of 
the other is greater than that, tadween the two measures of the 
same variable, and shows that one or both of them are too un- 
reliable to justify their use In actual practice such a situation 
rarely occurs, e.xcept when all of the coefficients are so low as to 
have little signilicaiice, or the number of cases concerned too 
small to yield trustworthy re.sults 

The reader should not infer from the preceding discussion that 
it 18 always, or even usuallj", desirable to correct coefficients of 
correlation for attenuation when it is possible to do so. Indeed, 
in dealing with a practical situation it is ordinarily not desmable 
to do so, since in such a case one is generally concerned with the 
measures as actually obtained, including variable errors, and not 
with ideal measur(*s that contain no such errors Yet, if, as is 
sometimes the case in experimental work, one is mterested in 
determining the true degree of relationship Ixdween the two 
variables concerned without n*gard to imperfections or in- 
accuracies in the measures, the corrected coefficients yield the 
desired information.® 

* Good discussions of certain points connected with attenuation may be 
found in the followmg 

Mark A May and Hugh Hartshorne, Studtev tn Deceit, I (New Ynrir 
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A fairly common situation of the sort just mentioned is in 
the comparison of test scores with criterion measures, that is, 
with measures taken as standard or true measures. The cor- 
relation between the test scores and the criterion measures is 
lower not only because of the unreliability of the test itself, 
but also because of that of the cntenon measures. Therefore 
it IS sometimes helpful to bi^ able to make what may be 
called a half correchon for attimuation, that is, to correct for 
the unreliability in the criterion measures, but not for that 
m the test scores In order to do this there must, of course, 
be two independent measures of the criterion If X is used 
for the criterion measure's and 1' for the test scores, the formula 
for the correlation between test scores and true criterion 
measures becomes “ 

_ r (x, + T, In 
i{iT\jiex}y — 


This is obtained by applying the Spt'arman-Brown formula to 
the denominator of the previous fonnula 
To illustrate the use of this formula suppose that a test cor- 
relates .60 with the sum of two criterion measures, and that 
the latter correlate .50 with each other Substituting m the 
formula gives 

60 

1 + 50 

which equals .73. In other words, the correlation between the 
test scores and the true cntenon measures is .73, which, rather 

Macmillan Co, 1928), Bcipk 11, Ch vi, “Methods of Correcting Coeffi- 
cients of Correlation for the Influence of Errors of Measurement ” 

Mordecai Ezekiel, Methods of Correlation Analysis (New York, John 
Wiley & Sons, 1930), pp 270-276 

•For further discussion of this fonnula see. Edward E Cureton and 
Jack W. Dunlap, “The Correlation Corrected for Attenuation in One 
Variable and Its Standard Error,” American Journal of Psychology, Vol. 
32, July, 1930, pp 405-407 

Clark L. Hull, Aptitude Testing (Yonkers-on-Hudson, World Book Co., 
1028), pp. 244-245. 



t/r 


2rr,x, 

1 -f- I'jij 
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than .60, is the measure of the true vahdity of the test when 
compared with the cntenon. 

There has also been suggested a modification of the ordinary 
formula that may be used when it is desired to correct for attenu- 
ation and at the same time to combine the* two senes of meas- 
ures of each variable into one series The following formula, 
which combines the Spearman-Brown formula w'lth the ordi- 
nary one for attenuation, is employed for this purpose: 


true r,j,+x- 




? (j-1 -t-Xs)(>/l 


/ \ 

1 ( \ 

\1 VlxJ 



To illustrate the use of this the example involving spelling 
and reading-test scores already employed wall be used agam. 
For the numerator it is ni'cessary to find the correlation between 
the combined spelling scores and the combined reading scores. 
Assuming that this is 50, the formula gives 


true r = 


50 


/'/2 X 70W 2 X 80\ 

y \r+ 70 Ai 4- 80 ^ 


.58. 


Constriction, dilation, and distortion. In addition to the 
correction for attenuation, there are certain other corrections 
which may be but larely are applied, therefore they will be 
named and described briefly, but no fonnulae will be given for 
them The other effc'cts for which corrections are needed are 
knovm as constnetwn, dilation, and dmlortion Constriction 
applies to a case in which some irrelevant correlation or rela- 
tionship has been admitted and reduces the size of the coeffi- 
cient obtained The corieciion for this, therefore, serves to 
increase the size of the obtained coefficient Dilation refers 
to the opposite, that is, tlii' exclusion of relationship that should 
be mcluded. The efiect of correcting for dilation, therefore, is 

“ For further discussion of this formula see. Edward E Cureton and 
Jack W Dunlap, “Siiearmaii's Correction for Attenuation and Its Probable 
Error,” Amertcan Journal of Psychology, Vol. 32, .April, 1930, pp 235-245. 

Clark li Hull, Apltitide Testing (Yonkera-on-Hudson, World Book Co., 
1928), p 243. 
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to decrease the size of the coefficient actually obtained. Dis- 
tortion is the term used when there is correlation between both 
of the two series and a third irrelevant variable. The effect of 
this third variable is to increase the obtamed coefficient so that 
applying the correction makes it smaller. A discussion of con- 
striction, dilation, and distortion may be found in Thorndike.** 


Exercises 


1. Compute the coefficients of rcliabihty for each of the following 
cases A. <r = 4, <r = G, B. £r,.„ = 2 1, er = 5.6, C. PE — 8.5, 
MdD = 12.5, D. PE, ^ = 1.5, MdD = 8 7. 


(TV 1 


the formula r 




2. Show that, since a i , 
reduces to r = r. 

3. What is the coefficient of reliability of the lengthened or repeated 
test in each of the following caM‘.->'^ A r — .70, twice as long; 
B. r = .85, three times as long, C r = .90, one and one-half times as 
long, D. r = .40, eight times as long 

4. How many tunes as long must tests with the given coefficients of 
reliability be made to attain those iiidicab'd''’ A r = .50, to be .80, 
B. r = .65, to be .90, C. r = 88, to lie 9.), 1). r = .92, to be 98. 

6. What IS the coefficient of \ali<lity of the lengthened test in each of 
the following instances'^ 

A. Coefficient of v'ahdity = 55, coefficient of rehabihty = .75, 

three times as long 

B. Coefficient of vahdity = 78, coefficient of reliability = .92, 

twice as long. 

C. Coefficient of vahdity = .40, coefficient of reliability = .85, 

four tunes as long. 

6. How many tunes as long must tests wth the given coefficients of 
vahdity be made to attain tliose indicated''’ 

A. Validity coefficient, 7(i, to l« 80, reluibihty coefficient, .88. 

B. Validity coefficient, 48, to be 60, reliability coefficient, .78. 

C. Vahdity coefficient, 62, to lie 66, reliability coefficient, .85. 

7. What IS the largest possible value to which each coefficient of va- 
hdity given in Exercises 5 and 6 can be raised by lengthening the test? 

8. What vahdity coefficient results from increasing the reliabihty 
coefficient as shown below’ 

A. Validity coefficient, .50, reliability coefficient, .70; increased 

to 90. 


•* E. L. Thorndike, An Introduction to the Theory of Mental and Social 
MeaeuremenU (New York, Teachers College, Columbia University, 1913), 
pp. 177-182. 
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B. Validity coefficient, .65, reliability coefficient, increaeed 

to .96. 

C. Validity coefficient, .42, reliability coefficient, .63; increaeed 

to .84. 

9. Find the coefficient of correlation corrected for attenuation in 


each of the cases given below. Select and use the appropriate formula 


for each. 

COEFTICrENTS OF CORRELATION 

between different measures 

COEFFICIENTS OF 
REUABIUTr 

A. 

.55, .64 

.75, .88 

B. 

.72, .78 

.82, 1.00 

c. 

.45 (test with sum of two criteria) 

.60 (criterion) 

D. 

.70 

.80, .84 

E. 

.78 (sum of two sinular senes) 

.88, .92 

F. 

.65, .68, .73, .76 

.92, .95 



CHAPTER XII 

RANK CORRELATION 

Introduction. Since much labor is required to compute the 
coefficient of correlation a shorter and easier method of deter- 
mining the relationship between paired measures is needed. 
To meet this need rank correlation has been devised. As will 
be seen later in connection with its computation this method 
is based upon the ranks of the measures concerned and not 
upon their exact magnitude's Its use is limited by the fact 
that it may be applied only to measures arranged in columns 
or simple senes and not to those' in a correlation table. When 
the number of cases concerned is small the rank method is 
easier than the product-moment methexl, but as the number 
increases it becomes progressively more difficult. In practice 
it is tifrely used when the number of cases is greater than thirty 
or forty. It does not yield so reliable a result as does the product- 
moment method, but since the unreliability m both is great 
when the number of cases is small, it makes comparatively 
little difference, from this standpoint, which is employed On 
the whole it may be desenbed as an approximate and easy 
method that is generally suihciently accurate if few cases are 
concerned. In some instances, however, it is employed with 
larger numbers of cases because only their rank orders and not 
their exact sizes are known. 

Assigning ranks. In order to compute a coefficient of rank 
correlation it is necessarj' that the measures in the senes con- 
cerned be ranked in order of size. Although ranking measures 
is a common procedure entirely apart from rank correlation, 
it seems desirable to explain briefly how it should be done. 
This will be illustrated by employing the first, or X, senes of 
twenty scores already used a number of times to illustrate 
other points. These scores are given in order of size in the first 

224 
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TABLE XLIX 
Absionino Ranks to Scores 


Score 

Rank 

125 

20 

119 

19 

118 

18 

111 

17 

106 

16 

100 

15 

98 

14 

97 

13 

94 

11.6 

94 

11.5 

92 

10 

89 

9 

88 

8 

84 

7 

82 

6 

81 

5 

77 

4 

75 

3 

74 

2 

72 ! 

1 


column of Table XLIX In the second column are tbe ranks 
assigned these scores The lowest scon- is given rank 1, the 
next lowest rank 2, and so on up until the highest receives the 
largest rank, ui this case, 20 The only point about which 
there is likely to Ix' any difficulty is that of assigning ranks to 
the two scores of 94. The score immediately below them, 92, 
has a rank of 10; therefore the next two ranks would be 11 and 
12. Smee the two scores of 94 are tied for these ranks, each is 
given the average of the ranks, 11.5 After this the assignment 
of ranks continues as before, the next, being 13, the next, 14, 
and so on. If there hail lx‘en three scores of 94 mstead of two, 
each would have received a rank of 12, since the three would 
have represented ranks of 11, 12, and 13, of which 12 is the 
average. 

The computation of rank coefficients of correlation. There 
are two formuls commonly employed m computing rank ooeffi- 
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dents of correlation. The simpler of these is 


R=l- 


62(7 

AT* - r 


In this, which is known as the footruU formula, R stands for 
the rank coefficient of correlation and g for the gain in rank 
from one series to the other. The other and better formula is 


p(rho) = 1 — 


62 /:)* 

- 1 ) 


In this p stands for the rank coefficient of correlation and D 
for the difference in ranks in the (wo si'ries. The latter was 
intended to yield results conijiarable with that obtained by the 
product-moment formula, but is based on the assumption of a 
rectangular rather than a nonual fonn of distribution of data, 
am) since this has been shorni to be fallacious in most cases, 
values of p do not correspond exactly with those of r. However 
the difference is comparatively small. In the case of R there 
is no close correspondence with r at all, but, as will bi* shown 
later, the values of both p and R may be transmuted so as to 
be approximately equivalent to those of r for the same data. 
The former vanes within (he same limits as does r, from — 1.00 
to d-l.OO, and has a dehnitely known error. The minimum 
value of /? is — .50 if the number of cases is odd and approxi- 
mately that if it IS even, and its mimmum -|-1,00. Its error is 
not definitely known. 

Table L illustrates the computation of coi'fficients of corre- 
lation accordmg to both rank fonnulaj. The first two columns, 
headed X and Y, contain th<* same two simes of data for which 
the product-moment coefficient has already been found. The 
third column, headed R^, contains the ranks of the measures in 
the first column, and the fourth, headed R„, the ranks of the 
measures in the second column. In the fifth column, headed 
D, are the differences between the corresponding ranks in the 
third and fourth columns These are detennined by subtracting 
each rank m the fourth column from the airresponding one in 
the third. Thus the first difference is -fl, from 20— 19, the 
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TABLE L 

Computation of Rakk CoaRSLATioN 


X \ 

Y 

R. 

Ry 


D* 

125 

96 

20 

19 


1.00 

119 

93 

19 

18 


100 

118 

97 

18 

20 


4.00 

111 

84 

17 

13 5 


12.25 

106 

89 

16 

17 

-1 

100 

100 

79 

15 

1 9 


36 00 

98 

88 

14 

16 


400 

97 

86 

13 

! 15 


400 

94 

84 

11 5 

! 13 5 


400 

94 

78 

115 

! 8 


12 25 

92 

76 

10 

7 


900 

89 

83 

9 

1 11 5 


6 25 

88 

83 

8 

11 5 


1225 

84 

75 

7 

6 


100 

82 

80 

6 

, 10 


16 00 

81 

72 

5 

' 4 


100 

77 

73 

4 

5 

-1 

1.00 

7^ 

66 

3 

2 

+i 

100 

74 

79 

2 

3 

-1 

100 

72 

62 

1 

1 

0 

00 





= 21 0 

128 00 - SD‘ 


R 


1 - 


fi X 21 
20 * - 1 


= 1 


399 


.68+ (r 


89) 


P 


J6_XJ128_ _ 

-1) “ ^ ” 7980 


90+ (r =. .91) 


second also is +1, from 19 — 18, the third is —2, from 18— 20, 
and 80 on. The last, or D'\ column contains the squares of the 
entnes m the D column. The sum of the positive entries in the 
D column is found, in this case bemg 21. It is known as Xg 
or SG, that is, the smnmation of the gams. The accuracy of 
the addition may be checked by totaling the negative entries, 
which should give the same numerical result as the positive. 
This sum, along with N, here 20, is substituted in the formula 

6 X 21 

for R, thus giving R = I - ~ .68+. The sum of all 

the entries in the £>• column, denominated 2Z)®, is employed 
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in the formula for p. In this case 

_ 6 X 128 

^ ^ 20 ( 20 * - 1 ) 


.90+- 


It is decidedly helpful m ranking the measures m the two 
series to have them arranged in order of size; therefore the 
entries in one column, usually the first one, should be arranged 
in this order when one begins the construction of a table for 
the computation of rank correlation If the corresponding 
order of those m the other column is very confused it is prob- 


ably worth-while to arrange them in order by themsi'lves and 
assign ranks, then transfer the ranks to their proper places in 
the Ry column. 

The computation of R and p may be considerably facilitated 
by the use of a table such as has been suggested by Curcton. * 
For this purpose Table LI is given In it are tabulated the 


values of 


6 


and 


6 


_ 1 _ 1 ) 


for values of N from 10 to 


TABLE LI 

Values or . ■ : and — :r Corresponding to Values or N 

. A’ — 1 A(A’ - 1) 

' FROM 10 TO 40 


N. 

6 

6 

N 

6 

6 

N 

6 

6 

A» - 1 , 

N[N’‘ - IJ 

A' - 1 

AfA» - 1,1 

A> - 1 j 

.VfV’ - )> 

10 

.06061 

006061 

20 

01. -,01 

(XX)752 

30 

00667 

000222 

11 

.05000 

004545 

21 

01364 

0006.50 

31 

00625 

000202 

12 

.04196 

003497 

22 

01212 

00056.5 

32 

00587 

000183 

13 

.03571 

002747 

23 

01136 

000491 

33 

(X).5.51 

0(X)167 

14 

.03077 

002198 

21 

01013 

00013.5 

31 

(X)519 

000153 

15 

02679 

001786 

2.) 

00t)62 

000.38.5 

35 

00490 

000140 

16 

.02353 

001471 

2f) 

.00889 

000342 

36 

00463 

000129 

17 

.02083 

001225 

27 

(X)824 

00030.5 

37 

(XI439 

000119 

18 

01858 

.001032 

28 

00766 

000274 

38 

(X)416 

.000109 

19 

.01667 

000877 

29 

00714 

000246 

39 

00395 

.000101 







40 

00375 

000094 


' Eklward E Cureton, “Note on the Computation of the Rank-Differ- 
ence Corrdation Coefficient,” Journal of Educational Psychology, Vol. 18, 
December, 1927, pp 627-630 
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40 , inclusive. Employing this table, one needs only to multiply 
Sff or 2£)* by the proper entry in the table and then subtract 
the result from 1.00 in order to determine the value of R or p, 
as the case may bo. Applymg this to the example given in 
Table L, we find the tabular entries corresponding to N = 20 
are .01504 and .000752. Therefore R = 1 — .01504 X 21 and 
p = 1 — .000752 X 128 which, of course, give the same results 
as those previously obtained, 68 and .90. 

Changing R and p into t. It is common practice that instead 
of rank coefficients of correlation being used as obtamed, they 
are changed into vulue.s more nearly equivalent to product- 
moment coefficients of correlation. This may be done by means 
of the following two formulie, the first of which is used with 
R and the sf'cond with p r = 2co8j (1 — R) — 1, and r = 
28in(fp). Table's hav'e been prepared from which the values 
of r corresponding to those of R and p may be read off directly. 
Table LII presi-nts the values of R and the corresponding ones 
of r. For the example given in Table L, in which R = .68, the 
corresponding value of r accordmg to the table is seen to be 
about .89. 

A similar table might be presented for p, but smee the dif- 
ferences are comparatively small and do not change greatly, 
the following approximate rule may instead be apphed. If p 
equals from tX) to 10, make no change, if from .11 to .36, add 
.01; if from .37 to .76, add 02; if from .77 to .94, add .01; if 
from 95 to 1.00, do not change. Since m the example just 
given p = 90, the corresponding value of r is obtamed by 
addmg .01, and is, therefore, 91. 

It will be recalled that the product-moment coefficient of 
correlation for these data was 91, the same as the value of r 
just obtained from p, and only two points different from that 
obtaini'd from R. In most instances, as in this, the values of r 
obtained from p and R approach quite closely to those obtamed 
by the direct computation of r. In very few cases is the differ- 
ence as great as .10 and in most instances it is not more than 
. 05 . 

In connection with rank correlation it should be noted that 
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TABLE LII 

VALtTES OF PKODXJC?r-MOMKNT r CoRRESPONDINa TO VaHIOUB VaLOM 

OF Rank R * 


Part A Positive Values 


R 

r 

R 

r 

R 

r 

R 

r 

R 

r 

.00 

000 

.20 

338 

40 

618 

60 

827 

80 

956 

.01 

.018 

.21 

354 

41 

630 

61 

836 

81 

.961 

.02 

.036 

.22 

369 

42 

642 

62 

844 

82 

965 

.03 

.054 

23 

384 

43 

654 

63 

852 

83 

968 

.04 

.071 

24 

399 

44 

666 

64 

860 

84 

972 

.05 

089 

.25 

414 

45 

677 

65 

867 

85 

975 

.06 

107 

26 

429 

46 

689 

66 

875 

86 

979 

.07 

124 

27 

444 

47 


67 

882 

87 

982 

.08 

.141 

28 

458 

48 

711 

68 

889 

88 

984 

.09 

.159 

29 

472 

49 

721 

69 

896 

89 

987 

.10 

.176 

30 

486 

50 

732 

70 

902 

90 

989 

.11 

192 

31 

500 

51 

742 

71 

908 

91 

991 

.12 

. 209 

32 

.514 

52 

7.53 

72 

915 

92 

.993 

.13 

226 

33 

528 

53 


73 

921 

93 

995 

.14 

.242 

34 

541 

54 

772 

74 

926 

94 

996 

.16 

259 

35 

.554 

55 

782 

75 

932 

95 

997 

.16 

.275 

36 

567 

56 

791 

76 

937 

96 

.998 

.17 

.291 

37 

580 

57 

801 

77 

942 

97 

999 

.18 

307 

38 

593 

58 

810 

78 

947 

98 


.19 

.323 

39 

606 

59 

818 

79 

952 

99 










1 00 



Part B Ncoativb Values 


R 

r 

R 

r 

R 

r 


r 

R 

r 

.00 

.000 

10 

187 

20 

382 

30 

584 

40 

791 

.01 

018 

11 

206 

21 

402 

.31 

605 

41 

812 

.02 

.036 

12 

225 

22 

422 

.32 

625 

42 

833 

.03 

.055 

13 

244 

23 

442 

33 

646 

43 

854 

.04 

.073 

14 

264 

24 

.462 

34 

666 

44 

874 

.05 

092 

15 

283 

25 

482 

35 

687 

.45 

896 

.06 

111 

.16 

303 

.26 

603 

.36 

708 

.46 

916 

.07 

130 

.17 

323 

27 

523 

37 

729 

.47 

.937 

.08 

148 

18 

342 

28 

543 

.38 

.749 

.48 

958 

.09 

.167 

.19 

362 

.29 

.564 

.39 

.770 

49 

.979 









.50 

1.000 


*Tbe Tsluw were computed by the formuls r Zoos ^(1 — R) ~ 1 
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a rank coefficient of 1.00 indicating perfect correlation may 
frequently be secured when the product-moment 
correlation is somewhat lower. This is because rank ^ 
methods do not take into account how much larger 23 50 
or smaller one measure is than another, but merely 22 30 
the fact that it is larger or smaller, whereas the 21 25 
product-moment method takes account of the exact 20 IS) 
amount of difference. For the data given at the ® 

nght, for example, the measures of both are m the yj 2 
same order, and therefore both rank coefficients of 
correlation arc 1 00, but r is only .94 

Hull ^ has suggested a method of secunng a product-moment 
coefficient of corridation from ranked data that is based upon 
the tran.smutat ion of ranked measures into linear or numerical 
measures Ordinarily it is employed only when there are groups 
of ranked measure's It diM's not appear to the wnter, however, 
that this method has any advant^es over the computation of 
a rank co<‘fficient and its transmutation into r The amount of 
work rc'quu-ed by the two methods is about the same. The 
result doi's not appear to be any more reliable, and the method 
is not at all well known Thi'refore it will not be explained m 
detail here. Perhaps its one real advantage is that it can be 
employi'd with data tabulated in a correlation table Hull has 
also prepared a table by which ranks may be changed into 
linear scores for use with this method ’ 

Coefficient of correspondence. The coefficient of correspond- 
ence IS not, a method of rank correlation, but serves the same 
purpose — to give a somewhat rough measure of relationship 
between two series of measures. It may be defined as the 
per cent of individuals that have the same relative position 
within the group in one series of measures as in the other. 
This defimtion depends upon the meaning given to the ex- 
pression have the same relative position. There are several ways 

• Clark L. Hull, ‘*The Computation of Pearson's r from Ranked Data,” 
Journal of A-pplxed Psychology, Vol 6, December, 11)22, pp 385-390. 

•Clark L Hull, A-plxtude Testing (\ onkers-on-Hudson, Worid Book Co., 
1928), pp. 491-492 
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in which this expression is interpreted and therefore several 
ways in which to compute coefficients of correspondence. 

One of these is to rank the measures m the two senes and to 
consider an individual as maintaining the same relative posi- 
tion if his ranks do not differ by more than a certain number. 
There is no agreement as to what this number should be. It 
is usually more or less dependent upon the total number of 
cases, being small when the total number is small, and large 
when it is large. 

Another somewhat similar method is to divide the two 
series of measures mto groups, each containing an equal num- 
ber, by finding the tertiles, quartiles, quintiles, or other divi- 
sion pomts. All individuals in the same third, fourth, or fifth, 
etc., of the two distributions are considered as having the same 
relative rank. It is perhaps most common to make use of quar- 
tiles in this coimection, although tertiles and quintiles are com- 
monly used and other division points occasionally. ' 

What 18 probably the most satisfactory method from a statis- 
tical standpomt is to base relative position upon the deviation 
of each measure from the average of its senes This deviation 
is expressed m terms of some measure of deviation. An indi- 
vidual IS considered as maintaining the same relative position 
when his deviations in the two senes do not differ by more 
than IMD, l<r, or IMdD, as the case may be. This method m- 
volves considerably more labor t han either of the others 

The example m Table LlII illustrates the application of 
these vanous methods of computing the coi'fficient of corre- 
spondence. The first two columns show the marks of sixteen 
pupils m grammar and spelling. The third and fourth contain 
their ranks. In the next, headed Cottk, that is, correspondence 
by ranks, a figure 1 is placed after each individual whose 
ranks in the two senes do not differ by more than 3.'* The 
number of cases in which the ranks do not differ by more 

‘ The use of 3 is entirely arbitrary. It was chosen liccause it is one-fifth 
of the greatest possible tlilTcrence in rank, and therefore roughly ooiro- 
sponds to the distance between quintile (joints Any other number, such 
as 2 or 4, nught have been selected instead. 
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than 3 is 13. Therefore the coefficient of correspondence ao> 

13 

cording to ranks, a difference of 3 being the critenon, is or 
81 25 per cent 

The sixth column, headed Cottq, contains Ts for those indi- 
viduals whose marks fall m the same fourths of the two series. 
For example, smce the third quartiles of both series are 90.6, 
each individual, both of whose marks are above 90.5, has a 1 
after his marks. Likewise any individual m the next to the 
top fourth in both senes, that is, whose grammar mark is be- 
tween 85 and 90.5 and whose spelling mark is between 84.5 
and 90.5, has a 1 in the Cottq column and similarly for the 
other fourths. As there an' ten such cases, the coefficient of 

oonespondence by quartiles is or 62.5 per cent 

The remaining columns contain the work necessary to secure 
a coefficient of correspondence according to the mean devia- 
tions. The first two, headed do and d.s, contain the deviations 
from the mid-scores From these the mean deviations of the 
two series are found. They are, respectively, 7.25 and 8 00. 
These are then divided into the deviations m the d columns 
and the resulting quotients given in the next two columns, so 
that these latter two columns contain the deviations expressed 
in terms of their respective mean deviations as units In the 
last column a 1 is placed opposite each pair of deviations which 
do not differ by mo?e than 1 00 MD Since there are 12 such 
cases the coefficient of correspondence, using \MD as the cri- 
12 

terion, is — , or 75 per cent. If the standard or median devia- 
lo 

tion were used instead of the mean deviation the procedure 
would be similar, that is, <t or MdD would be divided into the 
deviations just as MD is in the example. 

A question that sometimes arises in computing coefficients 
of correspondence is whether or not to count a pair of measures 
as corresponding if one of them happens to come exactly upon 
the division point between two of the groups into which the 
series are divided. For example, suppose that a measure is m 
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the lowest fourth of one series and that the corresponding 
measure in the other series is just at the first quartile, which 
of course is the point dividing the lowest fourth from the next 
higher fourth. It is customary in such cases to give the benefit 
of the doubt, so to speak, to correspondence, that is, to count 
two such measures as corresponding. The same would also be 
done in the case of a measure m the second fourth of one series 
for which the corresponding measure in the other series was at 
the first quartile. 

The coefficient of correspondence is not so exact a measure 
of relationship as i.s the coefficient of correlation If, however, 
the measures being dealt with are not very rehable, or if only 
a rough measure of relationship is desired it may be used with 
satisfactory results There are certain situations also in which 
its use* yields pertinent information. For example, some school 
systems group the pupils of each grade into three groups accord- 
ing to their scores upon some te.st, one group containmg those 
making the highest scores, another those making the lowest 
scores, and the third the others. If such a system desires to 
check this classification with some criterion to determine 
whether or not pupils haie been placed in the proper sections, 
the use of the w'cond method suggested above, that is, the 
detennination of how many pupils w'ould be placed m the same 
section by both the test scores and the cntenon, gives valuable 
information as to the validity of the original sectionmg. If 
the three sections m such a case are of the same size the ter- 
tile pomts ought to be used It may tn*, however, that the 
average section contains one-half of the pupils and each of the 
others one-fourth In this cast' the three sections or groups 
will be composed, respectively, of the pupils above the third 
quartile, those from the third down to the first quartile, and 
those below the first quartile. In either case the number and 
per cent of pupils properly placed, also of those misplaced, 
can be found. 

It should be emphasized that suice there are several fairly 
common methods of computing the coefficient of correspond- 
ence the one used should always be specified 
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Exercises 

1. Compute both rank coefficients of correlation and find the cor- 
responding values of the product-moment coefficients for each of the 
sets of data given in Exercise 1 at the end of Chapter IX (see page 
184), 

2. Compute the coefficients of correspondence according to each of 
the methods illustrated in Table LIII for the data in A and B of Ex- 
ercise 1 at the end of Chapter IX (see page 184). In the first method 
use a difference of four. 
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The equation of a straight line. Since the coefficient of cor- 
relation shows only the general trend or degree of relationship 
between diffi'rent series of measures, there is need for something 
to express this relationship more dehnitiiy This need is met 
in part by the regression coefficients and equations Since the 
latter represents the regression hnes, which are the straight 
lines most nearly fitting the means of the columns and rows of 
a correlation table, the equation of a straight hne will be bnefly 
explained before the regression equation itself is discussed 
Probably the simplest fonn of the equation of a straight line is 

Y 

that known as the slope form. This is often written m = ^, or 

Y = mX, in which m is the .slope of the line, that is, the constant 
ratio which the Y ^alue of any point in the line bears to the 
corresponding X value, on a figure so drawn that the line goes 
through the origin. To illustrate the equation of a straight line, 
Figure 38 has bi'en prepari'd It presents the A'T-axis system 
as explained m Chapter III, with four straight lines thereon. 
For one of these, AB, the vertical, or Y, distance of each point 
m the Ime is half that of the horizontal, or A' distance, therefore 
the equation of this line is m = .5, or Y = .5X For the line CD 
each value of Y is equal to 1 25 times the corresponding value 
of X, so that for it wi = 1 .25 or F = 1 25X. Both of these lines, 
it will be seen, go through the origin, O. 

If it is desired to express the equation of a straight line tha|« 
does not go thrQugli the origin, another tenn is required. Th|||, 
term shows the^stance from the origin at which the line mteiK 
cepts the X- This Atance, whidi 

is called thp Mfreept, is often rej^^nted by*. Thus the’ 
equation of.i&.||wght line becorne|||k*= mX + 6. This is the 
generalized .’ligand applies witq^B^the line goes through 

237- 
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the origin or not. The line EF in Figure 38 does not go through 
the origin. Its equation is F = .75X + 2, which means that for 
each point on the Ime the value of Y is equal to 2 plus | the 
corresponding value of X. 2 is added to .75X because the line 
intercepts the F-axis two points above the X-axis, so that F has 



no 38 COORDINATE AXI.8 SYSTEM WITH FOUR STRAIGHT 

LINES 

The equations of the four line^ are as follows AB. Y = 6A, CD. Y — 1.25X, 
EF, Y = 7:,X -h 2, GH. K = - 2 ~ 3 

a value of 2 when that of X is 0 Another line, GH, is also con- 
tained m the figure. Its slope is — 2 5, that is, F decreases 2.5 
units for each increase of one unit in X, and vice versa, and its 
intercept on the F-axis is — 3,smce it intercepts it at three points 
below the origin. Therefore its equation is F = — 2 5X — 3. 

Although the equations just given have been written by plac- 
ing F on the left and its value in terms of ^ on the nght, they 
may be reversed and X placed alone on thclleft. When this is 
done the slopie, which is then that of X and not of F, becomes the 
reciprocal of the F slope and the intercept becomes that on the 
X-oxis and not that on the F-axis. Therefore the equations for 
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the four straight lines shown in the figure may also be written as 
follows, as well as in the way already given . 

AB, X = 2F EF, X = I 33y - 2.67 

CD, X =.8F GH, X = -AY - 1.2 

These equations would be used to find the value of X when the 
value of Y was already known, whereas the first set of four 
would be used to find the value of Y when that of X was already 
known. 

The regression equations. The regression equations are the 
equations, two m number, that best fit, that is, come nearest to, 
the means of the columns and of the rows, respectively, in a 
cortelation table The one that comes nearest to the means of 
the rows is called the regression hne of X on Y, or, in other 
words, the corresponding equation is that by which X values 
may be found when those of Y are already known Correspond- 
ingly the regression line that best fits the means of the columns 
is the regression hne of i' on X, and from its equation, values of 
y may be determined when those of X are already known. 
Unless the coefficient, of correlation equals 1 00, neither re- 
gression line nor its corresponding equation yields the exact 
values of one variable associated with values of the other, but 
only the most probable values. The closeness with which the 
cases, when plotted, approach the regression line indicates the 
degree of accuracy of the values obtained from the equation or, 
in other words, the smallni'ss of the differtuices between the 
scores computed by the regression equation and the actual or 
true scores. 

Regression lines are illustratiMl in Figure 39, which represents 
the data included m Tables XXXII and XXXVUI. The 
figure contains the means of both the rows and columns, each 
taken as being fiv^ units in width. The mean of each row is 
shown by a circle, gbd that of each column by a small cross. The 
line AB representythe regres.'sion of X on T or, in other words, 
best fits the means of the rows, and the hne CD represents that 
of y on X, therefore best fits the means of the columns. It will 
be seen that on the whole the circles are not far from the line 
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AB, nor the crosses from CD. This is to be expected, since the 
coefl&cient of correlation for the given data is fairly high. 

The equations of the lines of regression of two series of cor- 
related measures are commonly given in terms of the means, 
standard deviations, and coefficients of correlation of the two 
variables. The expressions that show the slopes of the lines, 



FIG. 39 CORRELATION GRAPH CONTAINING REGRESSION LINES 

This represents the data in Talile.i XXXII and XXXVIII Each dot is a 
case, each circle the mean of a row . and each crosa that of a column AB is the 
l^ressiou line of X on Y and Cl) that of Y on X 


called the regression coefficients, may bt' found readily from the 
last two They are r— and r— . The first, which shows the slope 

O']/ tTj 

or regression of X on Y, i.s often called and the second, which 
shows the regression of Y on X, is called by If j and y are used 
to express the measures in terms of deviations from their respec- 
tive means, we may wnte x = r—y or b^y, and y = r^x or 6„x. 

<r„ (T, 

Usually it is more convenient to express measures in terms of 
the measures themselves rather than m terms of deviations fwiiirf 
their means. To change the equations just given to this basis, 
* is replaced by its value, X — and y hy Y — My. The 
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equations then become 

X-M, = r-(Y - My) or K{Y - My), and 

(Ty 

Y - My = r~^X - M.), or by{X - My). 

By transposing and removing parentheses these may be changed 
to the form 


X = r— F + My — r^^My, or b^Y + My — bJMy, and 

(Ty (T y 

Y = r^X + My - Ay My, or hyX + My - byMy 
(Tx (T X 

By substituting the pioper values for the M’s, tr’s, and r, and 
combining the last two l<-niis, the»‘ equations take the form of 
X — ciY + kt Jind }' = ciX + Aj, m which the c’s and k’s are 
numerical constants, c Ixang the same as 6, and k equal to 
M — bM Th(' actual application of these equations may be 
illustrated by mi'ans of the data already employed in connection 
with the coefficient of correlation For those given in Ta- 
ble XXX\'III the following values should be substituted in the 
equations Cy — lo o, cTj, = 8 95, My = 94 , My = 81 , t = .877.* 
If these substitutions are made in the first fonn of the equations 
for X and respect u ely, we havt‘ 


A' 

F 


877j;j]- + 94 

877^.^?.V + 81 

io .) 


,«77^&l.and 

877^.^'’94 

lo.o 


These become X = 1 519F -f 94. — 1 519 X 81., which reduces 
to A = 1.519F - 29 04, and 1' = .506A -|- 81. - 506 X 94., 
which reduces to F = .506 A' + 33 44. 

After the equations ha\e been put in the last fonn given they 
are ready to be used in estimating measures in one senes when 
those in ^ other are known There is, of course, no necessity 
vjisr doing this m the case of the particular measures that were 

•The value of r is taken to three decimal jilaces siiiee only two would 
scarcely give satisfactory accuracy, in view of the multipliers to be used. 
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employed m computing the regression equations, since the facts 
are already known for them. The usefulness of regression 
equations, however, lies in their apphcation to other situations 
involving the same kinds of measures, and in which it is assumed 
the same relationship holds. If in such situations measures in 
one series are known, those in the other senes most probably 
associated with them can be estimated by means of the equa- 
tions. If one knows the values of the Y measures and wishes to 
estimate those of the X measures, the first equation, the one m 
which X appears alone on the left, is employed, whereas if one 
knows the values of the A' measures and wishes to estimate 
those of the Y ones, the second equation, in which Y appears 
alone on the left, is used Thus if one knows that a particular Y 
measure is 70, m a situation similar to that upon which the 
regression equations given above are based, and wishes to find 
the corresponding X measure, he should substitute 70 for Y 
m the equation X = 1 5191' — 29 04 This yields 77.29 as the 
most probable associated value of X. If a K measure is 75, this 
is substituted for Y and the most probable associated X measure 
is found to be 84.89, if F is 80, the most probable X value is 
92.48; and so on. If, however, instead of knowing the values of 
Y and wishmg to find A’, one knows those of X and wishes to 
find Y, one substitutes in the equation Y = .506A' -}- 33.44. 
Therefore if X is known to be 80, Y most probably equals 73.92; 
if X IS 90, Y most probably equals 78.98 ; and so on 
To illustrate the application of the regression equations 
further, use may be made of the data in Table XXXIX on 
page 168. Smce the X classes in this table arc not, strictly speak- 
ing, numerical, it is much more convenient in dealing with their 
regression to substitute numerical values for them. Probably 
the simplest and most, satisfactory way to do so is to assign 1 to 
the lowest, or F— , class, 2 to the next, or F, class, and so on up 
until 12 is assigned to the highest or A-j- class, therefore these 
substitutions will be made. For these data er, = 2 67, a, = 
6.36, M, = 6.05, Mx = 84.49, and r = .704. Substitutmg thefle 

2 67 2 67 

values in the equations, X = •704g^F + 6.05 — .704^^84.49, 
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and Y = .70ij^X + 84.49 — .7042^6.05. These reduce to 

X = .2967 - 18.96 and Y = 1.677X + 74.34. Therefore, in a 
situation similar to that from which the data in the table were 
obtained, a pupil whose intelligence-test score, or Y measure, is 
78 will most probably have an X measure of 4 13, which cor- 
responds to a mark somewhat above an average C — . Similarly, 
a pupil whose score is 100 will have an X measure of 10.64, 
which corresponds to a low A. 

Most situations in which teachers or other educational 
workers use regression equations m order to estimate measures 
in one series when thosi' m another arc known have to do with 
predicting the future achu'vements or performances of pupils. 
Such predictions may be involved m determining promotion or 
failure, in assigning pupils to so-calU'd homogeneous groups, m 
giving educat lonal and voc.ational guidance, and in other more- 
or-less similar activities In such situations regression equations 
based upon the available data shown to correlate most highly 
with whatever it is desired to predict constitute the moat rehable 
means of prognosis They are subject to errors, the size of which 
depends upon that of the coefficient of correlation, and vanes 
inversely with it, but these errors are less than those involved in 
any other rai'thcxl based upon simple straight^hne relationship. 

As a partial check upon the accuracy of computation of co- 
efficients of correlation and of regression, one may make use of 

the fact that, smce 6, = r^—< and = r^i r- = bj>y, and, ac- 

(Jy (T X 

cordingly, r = 

Along with his method of computing the coefficient of cor- 
relation, Ayres suggests a different way of getting the regression 
coefficients * It will be recalled that his formula for r is 



’ Ijeonard P Ayres, "Coeffifients of Regression,” Journal of Rdueo- 
tiorud Research, Vol 1, May, 1920, pp 398-402 
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He suggests that bx be computed by dividing the numerator of 
the fraction just given by the quantity within the second 
parenthesis in the denominator and that 6,; be obtained by divid- 
ing the numerator by that in the first parenthesis. That is, 


ZXY - 




bx = 




(sr)' - 

X 


.> and by 


sxr- 


N 


IX‘ - 


(^xy 

N 


These equations, of course, yield c.xactly the same results as 
those already given. 

For the benefit of those acquainted with the method of least 
squares it seems well to iiiention that thf- regression equations 
are the same as the (■(juatums of the lines of “best fit” and 
therefore may be obtaiiu'd by tlu* methods commonly employed 
in that connection Sinci* tlu‘s(' methods are based upon thi- use 
of the measures themselves, they cannot be employed without 
modification if the scon-s have beim groujicd in classes or re- 
duced by the subtraction of assumi'd means or otherwise. Two 
equations are employed, and from th(>se the values of the regres- 
sion coefficients and the constants in the regression (“quations 
can be detemimed. Using r and k, as on page 24 1 , to ri'fer to the 
two elements other than the lanable m a regnvssion equation, 
the least square equations for A' are IS.Y = Cx'^Y + Nkj and 
SXy' = + kx^Y and those for }’ art' 217 = c„21A' -)- Nhy 

and 2X7 = CylX‘^ + A-„2A' 

The data m Table- X.X.XIII may be employed to illustrate 
this method. Substituting the proper values thi-n-from in the 
first pair of equations just given yields 1876 = 1614c, + 20A:, 
and 153,955 = 131,964c, + 1614fc, To sohe thi-se A, may be 
eliminated by multiplying the first equation by 807 and the 
second by 10 and then subtracting the first from the second, 
thus: 

1,539,550 = 1,319,640c, -|- 16,140/1:, 

1,513,932 = 1,302,498c, + 16,140A, 

25,618 = 17,142c, 

Dividing gives c, = 1.494, and, by substituting this in either of 
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the equations, fc, is found to be —26.77. Therefore the desired 
equation is X = 1.494 K — 26.77. Solving the second pair of 
equations in similar fashion gives Y = .549X + 29.20. These 
two equations are the same as obtained by the application of the 
usual regression methods, based on the means, standard devia- 
tions, and the coefficient of correlation. 

Although the regular regression coi'fficients denominated by b 
already given in this discussion are those commonly used, yet 
in some casi's what arc known as d (beta) coefficients are em- 
ployed These differ from the others m the- fact that they are 
expressed in terms of .standard units or scores, that is, m scores 
that are .secured by stating each variable in units of its own 
standard deviation Therefore these coefficients may easily be 
secured from the regular n'gression coi'fficients by the following 
simple foniiuhe 





it will be seen that hy .substituting for 5, in the first of these 
j8i = r Similarly, from the second, /3„ also = r This is merely 
equivalent to saving that for simple or zero-order correlation 
the cix-fficient of correlation indicate.s the mcrea.si' or decrease 
in one vanable associated with a unit increase or decreast' of the 
other when both are expressed in standard units In the case of 
certain other forms of correlation the jS coefficients are not 
equal to the ccx'fhcient of correlation. 

Th(‘ wtioU' discussion ol it git'ssion lines so far refers to straight 
fines. It IS often true that the relationship between two variables 
is much bi'tter expressed by a curved than a straight line. In 
other words, an equation of the second or a higher degree often 
fits tJie.data better than dtu^ one of the first degree. In educar 

I, 

tional work it is not common, however, to go further than first 
degree, or rectilinear, relationship, especially insofar as regres- 
sion is concerned. In the case of correlation it is more often done. 
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Equivalent-score equations. Sometimes one wishes to find 
the score on one scale of measurement equivalent to a given 
score on another. No question of estunate or prediction is in- 
volved, as in regression, but merely one of correspondence or 
equivalence. In other words, the question at issue is, “What 
score in the other series corresponds to the given score m this 
senes?” not “What score in the other series is likely to be made 
by an mdividual who has the givtm score in this one"?” In order 
that two sets of measures correspond or be strictly comparable 
it IS necessary that they be ('\press(‘d in terms of the same unit 
and have the same zero point This requirement means that 
one set of scores must be expresst'd m terms of the other or that 
both must be expressed in tenns of some third scale One such 
method is based upon the regression equations with r given 
the value of 1 00 In other words, tlu> equn'alent-scorc formula 
is based upon the assumption that one scenes of scores as a 
whole is equivalent to anolhc'r senes, whereas the regression 
equations assume that the degree of equn’alence or correspond- 
ence IS only as groat as is indicated by the actually obtained 
correlation. The justification for considering r equal to 1 00 
is the assumption that the distribution of one trait in a particu- 
lar group of individuals is the same as that of another trait in 
the same group, or, as is more often the case, that the distnbu- 
tion of one set of scores is the same as that of another measur- 
ing the same or a similar trait. 

If in the regression equations given in the last section r is 
made equal to 1.00, it need not appear, so they become 

X = ^Y + M^- -My, and 

<Ty ffy 

Y = + My - ^M, 

Ox Ox 

These are the equivalent-score equations In writing them Si 
and S* are often used instead of X and Y to refer to the scores 
in the two senes, and correspondingly 1 and 2 as subsenpts 
instead of x and y Furthermore, since the scores found by 
these equations are not actual scores, but merely equivalent 
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scores or expressions for those of the other series, it is usual to 
add primes to the letters denoting those being found, whereas 
none are used for the actual scores. These changes made, the 
equations become : 

s; = + Ml- -Mi, and 

(T2 ^2 

= ^Si + Mi- ^Mi 

a\ (X 1 

The first of thesi' is used to express the scores of Series, or Form, 
2 in terms of Series, or Form, 1 , the second to express those of 
the first in terms of the .second Thus the left member of the 
equation denotes the series m terms of which the scores are 
expresst'd 

By a slight algebraic shift these equations may be changed 
to another form that is perhaps more useful in actual practice. 
All that IS m\ olvod is combining the first and last terms on the 
nght side. Doing this, 

S[ = Ml + ^(5, - Mi), and 

<Xi 

= Mi + -’(S, - Ml) 

<Xi 

In employing equivalent-score equations it is usual to select 
some one senes of scores as the standard or basic senes and to 
change the other series being dealt with so that they will like- 
wise be in tenns of this one Sometimes, however, all the series 
of scores are changed to some more or less arbitrary basis having 
a certain desired number as its mean and another as its standard 
deviation. For example, 100, 50, or some other desired number 
may be taken as the mean, and 10, or somethmg else, as the 
standard deviation The advantage of so doing is that the 
resulting series, being based upon a mean and a standard devia- 
tion that are round numbers, are generally easier to deal with. 
The <^ief disadvantage is that the transmuted measures are 
not expressed m terms of any of the actual scoring systems 
employed. 
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The application of the equivalent-score equations may be 
iUustrated by employing the same data as have been used for 
regression. Letting the subscript 1 refer to X and subscript 
2, to Y, the equations are : 

- Ml*' - 


« - iS®' + »■ - 


These reduce to <S; = 1 7^2Si — 46 29 and iS, = 577<!?i -|- 
26.76. From the first of these the .SJ, or A”, score equivalent to 
an Si, or Y, score of 70, for e\:unp!e, is found to be 74 95; that 
equivalent to one of 80 is 92 27 , and so on F rom the second 
we find that the Sj, or Y, scon' equu aienit to an »8,, or X, score 
of 90, let us say, is 78.69, that equivalent to one of 95 is 81.58; 
and so on. 

Estimated true scores Instead of estimating one series of 
scores from anotlier actuallv obtained senes, one sometimes 
desires to estimate theoretically triK' scores from those actually 
made. The equation for this pui|Kis<* may b<“ wntten as follows; 

= i-X -h (1 - r)M or r(X - M) -f- M, in which X'* 
represents the estimateri true score, r i.s the coefficient of rolia- 
bihty between two senes of .scores. A' refers to an actually 
obtamed score, and M to the mean of the actually obtained 
scores. Sometimes this eiiiiation is wntten in slightly different 
notation, as follows- <8* = oS + (1 — r)M or r{S — M) + M, 
thus corresfKindmg to th(> fonii of the equivalent-.score equa- 
tions rather than to the ordinary form of regn-ssion equations. 
By the use oi this one may estimate the piohable true score 
corresponding to an actually obtamed score 

The appheation of thi.s foniiula may be illustrated by assum- 
ing that for a given test the mean score is 54 and the coefficient 
of reliability is .85. Then for an actual score of 40 the estimated 
true score is given by 85 X 40 + (1 — .85)54 , which equals 
42.1; for 50 it is .85 X 50 •+■ (1 — .85)54 — 50 6; and so on. 
It will be observed that the estimated true score is always 
nea^r the mean than is the actual score This results from the 
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fact that the general effect of variable or chance errors is to 
increase the spread of the distribution of scores. 

Predicted scores on lengthened tests. It sometimes occurs 
that workers m the field of measurements wish to estimate or 
predict individual scores on lengthened forms of tests on which 
the scores are known. Horst * has derived equatioris in regres- 
sion form that may be employed for this purpose. 

Exerctses 

1 Secure the regression equations for the data given in each part of 
Exercise 4 at tlie end of Chapter IX on jiage 1.S5 

2 Using the equations found in Exerense 1, compute the estimated 
score m the other senes for each of the following scores. 

A Part A, iirst seru-, 82, 88, 92 

B. Part B, second senes, 10, 78, 220. 

C. Part C, second senes, !>, 1.'), 40. 

D. Part D, first serii's, 22, 30, 60. 

3. Secure the ('([uu alent-seore equations for the data given in each 
part of Exercise 4 at the end of Chapter IX on page 185 

4. By means of tlic ei|uivalciit-score equations found in Exercise 3, 
compute the eqiin alent score in the other senes for each of the scores 
given in Exercise 2. 

5. Computx' tiie estimated true scores for actual scores of 35, 42, 
and 48, on a test that has a nieaii score of 44 anti a coefficient of reliabil- 
ity of .92. 

•Paul Horst, ‘'The EcoiiomicaJ Collection of Data for Test Validatioo,” 
Journal of Expennwnial Eduralion, Vol 2, March, 1934, pp 250-‘253. 



CHAPTER XIV 

THE RATIO OF CORRELATION 

Interpretation and use. It has already been staled that since 
the relationship between two series of paired measures is not 
always best represented graphically by a straight line, it cannot 
always be adequately expressed by the coefficient of correla- 
tion and the regression equations Sometimc's the relationship 
is definitely curvilinear; hence, it is tx'st represented graphi- 
cally by a curved line which departs so much from the best 
fitting straight Ime as to indicate that the latter does not show 
the closeness of relationship The ratio of correlation is the 
measure most commonly used to indicate the amount of curvi- 
linear relationship existing It sumnianzes the deviations of 
the data in question from the curved Ime that best fits the 
means of the rows or columns, as the case may be, just as the 
coefficient of correlation summanzes the deviations from the 
best fittmg straight hne The value of the ratio of correlation 
vanes from zero to 1.00 It is alw'ays positive, but may denote 
either positive or negative relationship Thf“ dctenmnation of 
which sort exists must be made by an mspection of the data 
themselves or by other means The minimum value of the 
ratio of correlation for any given set of data is the coefficient of 
correlation. To compute the ratio the measures concerned must 
be arranged in a correlation table similar to that used for the 
coefficient. 

So far the term ratio of correlation has been used, but more 
properly it should be ratios of correlation. Then' are two such 
ratios for every correlation table, just as there are two lines of 
regression. One of them measures the cun ilmear correlation 
of X on Y, the other that of Y on X. The curve that best fits 
the means of the columns is not likely to be the same as the one 
that best fits the means of the rows, nor is the departure from 
the one likely to be the same as that from the other. The two 

250 
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ratios just referred to are abbreviated as follows: and ri„ 

(ti = eta). The former is the ratio of X on Y, the latter that of 
TonX. 

Computation. Several different forms for the computation of 
the ratios of correlation have been suggested The one given 
below, which was proposed by Crathome,' also by Holzinger* 
and by Dvorak ’ seems the best to use when, as is almost 
always true, the coefficient of correlation is also to be found. 
If, however, the coefficient is not desired, the form suggested 
by Yule * is probably as good Ayres ' has suggested a method 
that has the same advantages and disadvantages as his method 
of computing the coefhcient of correlation for data tabulated 
in a correlation i able 

The formula employed in connection with the method illus- 
trated in Table LIV are as follows: 



This table is the same as I'able XXX\TII except that the other 
work necessary for the computation of the ratios is added This 
consists of two additional columns at the extreme right and 
four additional rows at the bottom with certain calculations 
based thereon. The first of the two additional columns, headed 
(2a-)“, contains the squares of the entries m the Zz column. 
Each entry in the st^cond additional column, which is headed 

‘ A R Crathomc, ‘'Calculation of the Correlation Ratio,” Joitmal ef 
the American titalistical Assm lalum, Vol. 18, Scptemlier, 1922, pp 394- 
396 

’Karl J HolzmRer, ‘‘A Comlunstion Form for Calcidatmg and Corre- 
lation Coefficient and Ratios," Journal of the American StatuUcal Attoeuk- 
Uon, Vol 18, March, 19'23, ]ip 623-627 

•August Dvorak, "A Simplified Computation of Non-Lmear Correla- 
tion,” Journal of Educaivmal Rtecarch, Vol 25, Fehruary, 1932, pp. 99- 
104. 

* G. Udny Yule, An Introduction to the Theory of Slatietics, mnth edition, 
reviaed (London, Charles Griffin & Ck)., Ltd , 1929), pp 204-207. 

•lioonani P Ayres, "The Correlation Ratio,” Jottrnal of EduecUional 
Research, Vol 2, June, 1920, pp 4.52-456 
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for computing the sum of ilte Zx column and the Ty row u to ebeok with the iuxn of the fd^ row aiui ol the fdp 
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— ■ is obtained, as the heading indicates, by dividing the 

Jv 

entry in the previous column by the corresponding frequency 
or entry in the / column Thus for the first row of the table 
the entry in the column is 12, and so the corresponding 
entry in the column is 144. That m the last column is 
72, obtained by dividing 144 by 2, the correspondmg fre- 
quency 

The first two rows added at the bottom of the table, denomi- 
nated by and I'rv. have already been employed m Table 
XXXIX, which illustrated certain checks m thi' computation 
of the coc'fficient of comlation The other two rows are similar 
to the two columns (h'scnlied above, eveept that they run in 
the other dirc'ction Thus the first entry m the {"LyY row is 36, 
the square of the 6 fouiitl in the '^y row. Since the frequency 

for this column is 2, the first entiy in the — j — row is 18, ob- 

tamed by dividing 36 by 2 The sum of the last column at the 
right, m this cas<' 157 33, is, as the formula indicates, used in 
securing the valui' of y-y and that of the la«t row, 60 33, is em- 
ployed in securing the valui- of Substituting in the formula 
for the two ratios, we obtain values as follows 




= .90-, and 


60 33 _ 
_ 20 _ 
179 


= .96- 


The significance of differences between the ratios and tiie 
coefficient of correlatioa. Since the coefficient of correlation is 
a simpler and, for some purjios's, more convenient measure of 
relataopship than the ratirt, it is frequently of considerable im- 
portwBpe to determine whether or not the relationship between 
the t;|yo aeries of daia departs sufficiently from a straight-line 
re to mak;^,.the ratio a defimtely better e.vpre8Bion 
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of it than the coefficient. After a worker has acquired con- 
siderable familiarity with both measures, he may be able to 
determine by an inspection of the correlation table whether 
the relationship is sufficiently curvilinear to make it worth- 
while to compute one or both ratios of correlation If the means 
of the columns or of the rows approximate a straight line as 
closely as any curved one, the coefficient is a satisfactory sum- 
mary of the relationship This fact cannot be determined 
readily by inspection, however, if the difference is not very 
great. Therefore it frequently happims that after both the 
coefficient and the ratios have bien computed, one wishes to 
determine whether the difference in fheir magnitudes is signifi- 
cant, that IS, whether it indicates a curv'ilmear instead of a 
rectilinear relationship, or is merely due to chance errors m the 
data or inadequate samplmg 

The difference between the coefficient and the ratios is 
commonly interpreted in accordance with Blakeman’s sug- 
gestion.® He defined the criterion of linearity by the formula 

^ and stated the condition that if it is less 

.6745 2 

than 2 5 the difference between the ratio and the coefficient is 
not significant, whereas if the value of the criterion exceeds 
2.5 it is practically certain that the relationship between the 
variables is not adequately measured by the coefficient, but 
requires the ratio By clearing of fractions and squaring, we 
may change this requirement of Blakeman’s to the form 

— r-) < (is less than) 11 37, which is somewhat easier 
to use than the original form Substituting in this the values 
of 17 and that of r m the example solved in the text we have for 
7j^, 20(.90* - .86=) = 1 41 and for 20( 96“ - 86^) =3.64. 
Therefore it appears that the relationship of A' to Y is very 
nearly rectilinear and may be measured adequately by the 
coefficient, and that the relationsiiip of T to A is somewhat 
less definitely rectilmear, but still does not require the use of 
the ratio 

•John Blakeman, “On Tests for Linearity of Reip'ession in Frequency 
Distributions," Bwmelnka, Vol 4, November, 1905, pj) 332-350. 
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The point chosen by Blakeman and employed in the example 
given above is such that if the value of the expression is greater 
than the amount given, the chances are approximately ten to 
one that the difference between and r is significant, or, in 
other words, that the relationship is defimtely curvilinear. 
Although a chance of ten to one appears to be fairly satisfac- 
tory, it is not so strong or decisive a chance as is commonly 
required in other statistical matters. It has been suggested 
that instead of the expression given by Blakeman bemg less 
than 2,5 it should be le.ss than 3., and to correspond to this 
that instead of — r^) being less than 11 37, it should be 
less than 16.37 In this case the chance of significance if it 
exceeded the figure given is about twenty-two to one matead 
of ten to one. 

A nomogram for use in determming linearity of correla- 
tion has been devised by Gnffin ’ It is based on the reqmre- 
ment that — r= < 4 047, which is the same as that 

Niv* - rs) < 16 37 

Although Blakeman’s formula given above and others based 
upon it have been commonly employed m the interpretation 
of the ratio of correlation, there are two serious limitations to 
their use. The first is that , as has been pointed out by Fisher,* 
it takes no account of t he number of arrays in the correlation 
table The same data may show marked departure from linear- 
ity if tabulated m a certain number of classi*s or arrays and 
little or no departure therefrom if m another number, but 
Blakeman’s criterion, or any derived directly from it, does not 
give a satisfactory comparison or contrast k'tween two such 
situations The second limitation is that the criterion sets up a 
definite point above which values indicate curvilinear relation- 
ship and below which they indicate absence of such relation- 
ship. As will be made clearer by the discussion m Chapter XIX 
there is no definite critical point at which a measure ceases 

'Harold D Gnffin, “Noraogratn for Blakeman's Test for Lineanty <rf 
Regression,” Journal of Educattonai Psychology, Vol 23, September, 1^2, 
pp 460-461 

* R A. Fisher, SlatMlical McUuhIs for Research Workers, third edition, 
revised and enlarged (Edinburgh, Oliver & Boyd, 1930), pp 225-226 
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to be unreliable and becomes reliable or significant. It is merely 
a matter of arbitrary convention based upon expert judgment 
that leads to the definition and use of points of this sort. So 
in this case there is no definite point at which it can be said a 
relationship becomes curvilinear rather than rectilinear, and 
the assumption of such a point is arbitrary. 

Because of the second limitation just stat-ed, it is probably 
better not to employ such a fonnula, but instead to interpret 
the difference between the coetficu'nt and the ratio by a method 
more similar to that employed in connection with the signifi- 
cance or reliability ot most other measures This consists of 
comparing the difference between and r", often called f 
(zeta), with its standard or probable error This error, as well 
as the general method of mtorprelalion, will be given in Chap- 
ter XIX. 

Correctmg for too fine grouping. Ratios obtained as described 
above are liable to several lurors, the chief of which is that due 
to too fine grouping If thi' groujiing wen* so fine that each 
class of each variable, that is, each array, contained only one 
case, the value of rj would always tx' 1 00 and have no real 
significance. In other cases, as here, the (‘ffect of this error is 
to make the value obtained somewhat too large. A formula 
that may be used for correcting this error of too fine grouping 
when the number of cases is fairly large has been suggested by 
Pearson " as follows. 


Vtrue ~ 


In this ijtm* is the most probable value of rj for all cases of the 
sort upon which it is based, tj is the value actually obtained, 
and n is the number of arrays of the variable appearing first 
in the subscript of tj. Applying this formula to the data in 

•Kari Pearson, “On the Correction Necessary for the Corraktion 
Batio v" Biometnka, Vol. 14, March, 1923, pp. 412-417. 
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Table LIV, we obtain 



.81, and 


95 


In common practice this correction is not made, but if ratios 
based on tables m winch the nuinbi'rs of arrays are widely 
different are to he compared it .should Ix' applied 

The other errors iiiesent in the ratio are generally less in 
amount than that due to too fine grouping and will not be dis- 
cussi'd here In \eiw- car(>ful work they should, however, be 
corrected A discussion of the whole matter may be found in 
the reference to Pearson jiisi given and in Kelley 

In his di.scu'sion Pearson also suggests si'veral values that 
a ratio of coirelation must exess'd in older to be surely signifi- 
cant They aie so i.iiely employed in educational work that 
they Will not be gi\ eri heie 

Other measures of curvilinear relationship. The index of 
correlation is u geiier.d measure of curvilinear relationship that 
IS rarely einployc'd lu educational work c'xci'pt in the form of 
the ratio of coirelation, wliieh is a .special form of it. The index 

(T t/' 

is reprcsc'nted by tlu' sjmibol and is given by the ratio — > 

ffi, 

in which is tiie si.mdard deviation of value.s of ?/ estimated 
from a curve drawn to tit the relationship between the variables. 
For a fuller di.scussion of this nu>asure the reader is referred to 
Ezekiel “ For a more complete treatment of curvilinear corre- 
lation incluchng both the ratio of correlation and other methods 


’“Tniman L Kellev, \fflhixi (New 1 ork, Macmillan Co., 

1923), pp 2.38-2 l.S 

U»Mor(iecai Ezekiel, Methods of Correialton Analysts (New Y'ork, John 
Wiley <V !8ons, 1930), p. 119. 
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of detennining cumlinear relationships, and also for sugges- 
tions on computation, the reader is again advised to consult 
Ezekiel.** 


Exercises 

1. Compute the coeflBcient and the ratios of correlation for each of 
the following sets of data. 

A 


0- 

5- 

10- 

15- 

20- 

2.-)- 

30- 

35- 

40- T 

190- 







1 

2 3 

180- 





1 

1 

3 

5 

170- 




1 


4 

1 

6 

160- 




2 

3 

1 


1 7 

150- 

1 


1 

6 

2 

3 


13 

140- 



1 

5 

1 

1 

2 

10 

130- 



3 

1 

1 



5 

120- 




2 

I 

1 


4 

110- 


3 

1 


2 



6 

100- 

1 

1 


3 




5 

90- 2 

1 


1 





4 

80- 



2 

1 

3 



6 

70- 






2 

2 

4 

60- 






1 


1 2 

T 2 

3 

4 

9 

21 

14 

14 

9 

4 80 





B 





0- 1- 

2- 

3- 

4- 

5- 

6- 

7- 

8- 

9- 10- T 

50- 1 

2 


1 





4 

45- 1 3 

6 

4 


l 



1 

16 

40- 2 

2 

4 

2 


1 



11 

35- 1 1 

3 

4 

1 





10 

30- 2 

1 

3 


2 

1 

2 


11 

25- 1 



2 

3 

1 

1 

1 

0 

20- 




1 

3 

2 


6 

15- 

1 



2 

1 

4 


1 9 

10- 





3 

1 . 

1 

6 

5- 






, 


1 1 

0- 








2 - 2 

T 4 8 

15 

15 

6 

9 

10 

10 

3 

1 3 84 

“ Ilnd., pp. 66-110, 130-135, 300-317. 
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C 


10- 12- 14- Id- 18- 20- 22- 24- 28- 28- 30- 32- T 


650- 









1 


2 

1 4 

600- 










1 

3 

4 

650- 







1 

1 

2 



4 

500- 






1 

2 

3 

2 



8 

450- 





1 

3 

5 

1 




10 

400- 




1 

4 

8 

3 

1 


2 


19 

350- 




2 

4 

6 

3 

1 




16 

300- 



1 

2 

3 

5 

7 

1 

1 



20 

250- 


1 

3 

4 

4 

1 

1 





14 

200- 



2 

3 





1 

1 


7 

150- 

1 

1 

4 


1 

1 

2 





10 

100- 


1 

3 

2 




3 

1 



10 

50- 

1 

2 

1 









4 

0- 

2 

1 

1 









4 

T 

4 

6 

15 

14 

17 

25 

24 

11 

8 

4 

5 

1 134 


2. Compute the criterion of hneanty for each of the ratios of cor- 
relation found 111 Exercise 1 

3 Correct the ratios of correlation found in Exercise 1 for too fine 
grouping. 



CHAPTER XV 
PARTIAL CORRELATION 

Purpose and meaning. Tho ordinary coefficient of correlation, 
which has been previously t rivaled, measures the rectilmear 
relationship between .ni.st two i-anables. The size of such a 
coefficient does not indicate the nature of the relationship that 
exists. It may be that the correlation is due to the fact that 
one vanablc more or less includes the other, that both are 
affected similarly by outside factors, that is, by other variables, 
or that some other condition ('\ists Somi' light can often be 
thrown on the question by the use of coefficients of partial 
correlation. To illustrate their nature and usi' let us suiipose 
that a coefficient of correlation of .50 has been found between 
marks m history and in physiology, oni' of 65 bet ween history 
marks and scores on a reading test, and one of .60 betwf<*n 
physiology marks and ri'admg scores Thc'si' coefficients show 
that the relationship between reading and each of the other 
two subjects IS closer than that betwiMm history and physiology 
and suggest that marks in these subjects may lx' more or less 
dependent upon readmg ability, or at least include an element 
common therewith The c(K'tficients givim do not prove this, 
however, and much less do they indicate how' much of the 
correlation between history and physiology is due to the com- 
mon element and how much is not By the fonnula given later 
the coefficient of partial correlation of history with physiology, 
reading being held constant or eliminated, u found to be .18. 
In other words, almost two-tliirds of t^aObrrelation (.50) be- 
tween the two subjects is due to th^||pB#ence of 4 common 
element, cither reading ability or soe^riifactor also iBotAined 
therein, and only slightly over one-thiiti to other factors. • 

The result secured by partial correlation is the same as would 
be jflbtained if the two variables for which it is found were cor- 
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related in the ordinary manner after first having been arranged 
in groups for each of which the value of the third variable was 
the same. In the illustration used above if the pupils were 
divided into as many groups as there were differences in readmg 
ability represented, and the coefficients of correlation for the 
various groups found and properly averagi'd, the result would 
be 18, the same' as that found above There are, however, at 
least two rea.sons why this procedure is randy carneni out. In 
the first place, the labor invoked therein is much greater than 
that in th(' computation of thi* ciH’fficii'nt of partial correlation. 
In the si'cond place, unless the total number of cases involved 
IS decidc'dly large, the numbers in the groups, at least m many 
of them, an' so small that the coefficients obtained are not very 
reliable, and theiefore the results are not satisfactorj’ 

The meaning of partial correlation and what is accomplished 
thereby will probably be better understood if an illustration 
18 given Let us suppose, therefore, that the first three parts 
of Table L\' represent the correlation between chronological 
age and mental age in Grades IV, \T, and VIII, respectively. 
It will be seen by insjiection that there is no relationship be- 
tween the two, .so tli.at the coefficient of correlation for each 
case IS zero Howe\er, if the three sets of data are thrown 
together so as to fonii Part D, corndation appears to be present. 
Considering the dat.i m D as a whole, it is apparent that there 
is a tendency for high mental agi's to be a.s.s()ciated with high 
chronological ages, likewiM' low mental ages with low chrono- 
logical ages. The actual coefficient of correlation for this table 
is .77. However, if the coefficient of partial correlation between 
mental and chronological ages is found with the third factor, 
grade placement, held constant, it will be zero, or the same as 
the ordinary coefficient for I'acli of the separate groupis of data. 
Thus th(‘ use of th^inpartial correlation technique ehminates 
the effect of grade -pl^l^nent upon the relationship between 
the other liro variableM^ rtwcals that all the apparent cone- 
lation between them is doe to the element of grade placement. 

The question of whether or not the effect of one or mtnn 
variables besides the two of chief interest should be °liminwt|4i 
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or, in other words, whether ordinary or partial correlation 
should be applied, must be determined from a consideration of 
the problem. If one is interested in determining the correlation 
between two variables as it actually exists regardless of what 
contnbutes to it, simple correlation is the proper method to 
employ. If, however, one is interested in measurmg the rela- 
tionship between the two that is not common to other variables, 
partial correlation should be used. 

The methcxl of partial correlation, as is the case with the 
regular coefficient, measuri's rectilinear relationship It is con- 
ceivable, however, that it might be applied to curvihnear rela- 
tionship also If so, It would bear a relationship to the ratio of 
correlation similar to tliat it now bears to the coefficient. The 
partial coefficient has the same limits as the ordinary coefficient, 
its value ranging from —1 00 through 0 to -|-1 00 In the ex- 
ample given then' are only three variables, but there is no limit 
to the number that may be dealt with No matter how great 
the number, the effect of the formula is to hold constant or 
eliminate the influence of all except two and to determine 
the remaimng correlation between those two. The method of 
calculation is simjile, but as the number of vanables mcreases 
it becomes progressively much longer and more laborious. 

In connection with partial correlation it is common to speak 
of an ordinary or sunple coefficient of corn'lation as a zero- 
order coefficient. A partial coefficient in which three variables 
are concerned, that is, two correlated and the effect of one 
eliminated, is called a first-order coefficient ; one mvolving four 
variables from which the effect of two is eliminated is called a 
second-order coefficient, and so on. Thus the order of the 
coefficient corresponds to the number of vanables held con- 
stant or elimmated. 

Con^iutation of coefficients of partial correlation. The general 
formula for a coefficient of partial correlation (the number of 
variables concerned being represented by n) is as follows: * 

' The left side of this formula, rn 14 . . m, is read, “the (coafitefent of) 
partial correlation of 1 with t when S, i. . .n are bdd constant." Ttw 
words in parenthesis may be omitted 
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• (n - 1) — Un-tt . ■ . (w - l)-ran.84 ... (n - 1) 

V(1 — 34 . . . (n - 1))(1 — T'in-34 . . . (n - 1)) 

or, using k for Vl — in the denominator, 

rii 34 . ■ (n - 1) ~ r) „ 34 („ - IVTln 34 ... (n - 1) 

(kin 34 ... (n — l))(^2n 34 . . . (n — 1)) 

This formula shows that the coeffieient of partial correlation 
of any number of variables is compuk'd from the coefficients 
of the next lower order, that is, from thos(' involving one less 
vanable. For example, the partial coefficients of four variables 
are computed from tho.se of three, and those of threi' from 
zero-order coefficients of two Thus in solving any partial- 
correlation problem oik' must hmt hnd the ordinary, or zero- 
order, coefficients, then the partial ones for thrc'e variables, 
then those for four, and so on uj) a.s far as one desires to go. 
For three variables the fonmila given abo\'e becomes 

r,; - r nr23 

- jfaKl - ''D /n,-i^23 

This form is for the correlation of 1 with 2 when 3 is held con- 
stant For 1 with 3 w'hen 2 is constant, it is 


rn - r,2 r23 

^13 2 — 7^-^ OF 

V(i - /roXi - '’23) 

and for 2 with 3 when 1 is kept eomstant 


r|3 ~ ri; r; ; 
^12 ^23 


r--' — ; I- r, 


V(l - 


1*23 ~ ^12 rj3^ 
^12 ^1.) 


It Will be seen that the subscripts of a partial r coming before 
the point indicate the lanable.s between which th& fiorelatiOD 
is found, and those following the p<nnt the one ot ones held 
constant. Also the subscripts of the first r m the nanl&ator 
aire the same as the first two subsenpts of the partial r that is 
to be found. Those of the other two r’s in the numerator are 
obtained by taking the first and last and the second ‘ibd last 
subscripts, respectively, of the partial r that is to be found. 
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The two r’s in the denominator have the same subscripts as 
the last two in the numerator. 

The coefficients of correlation given near the first of the 
chapter may be used to illustrate the calculation of the partial 
correlation between three variables. Using the subscripts H, P, 
and R for history, physiology, and reading, we have 


fHP R = 


thh p = 


■50 - .65 X .60 

- .60^) 

65 - .50 X 60 

VU - oO^Ki - . 60 ^) 


.181 


.505, and 


TpR ri = 


60 - 50 X 65 


.418. 


In most cases it will be found that, as here, the coefficients of 
partial correlation are smaller than the zero-order coefficients. 
In general, partial ccK’fficients of any order are smaller than 
those of any lower order There may be exceptions, however, 
especially when oni' or more of the lower-order coefficients is 
negative For example, if rn = .20, = 40, and = —.30, 

then Tiij.j = 366, /n 2 = 492, and r 23 1 = —.423. 

When four vanabk's are concerned, two of which are to be 
held constant, the formula for 1 with 2 when 3 and 4 are held 
constant is as follows 


ri 2 3 — rn 3 r>4 3 3 — ri4.3 rj4 « 

' 12 84 — or j 

V'(l - HiaHl — rltj) kiizkus 

Since the order of the subscrijits after the pomt is not significant, 
this may also lx‘ written as follows- 

^12 4 — 1 !t 4 r23 4 ri2 4 — ri5.4-rjj.4 

•= — ; or z i 

V(1 - r\3 i}{l - lis-i) kn 4 fcss.i 

It will be noticed that m these formulse the subscripts of the 
first r in the numerator are the same as the first three subscripts 
of the jr that is to be found , t hose of the second r in the numerator 
are th^^first and last followed by the third of the r to be found, 
and those of the third r are the second and last followed by the 
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third of the r to be found. Those in the denominator are again 
the same as the last two in the numerator. Moreover, the sub- 
script following the point is the same in all cases, being the third 
one of the r to be found. 

The advantage of havmg two formuhe as given above is that 
the desired value may be computed by both for purposes of 
checking. Coefficients of the third and higher orders can be 
computed in an ever-increasing number of ways In practice it is 
rarely worth-while to calculate each m more than two ways, as 
this suffices for checking 

To illustrate the computation of the coefficients of partial 
correlation when four vanables are concerned the data given 
above for history, physiology, and readmg may be used, pro- 
vided a fourth variable is included Let this be the score on Ein 
intelligence test and let the additional zero-order correlations 
be Tib = .70, rjp = .75, and rm — .80 Three of the first-order 
coefficients have already been found as follows: tbp.r = .181, 
fBB‘P = -505, and rpp.u = .418 The others are- 


tbpi — 


tbri 


rpRi = 


tbi-p = 


tbib = 


rpi-B = 


rpi.R = 


.50 - 70 X 75 
V(1 - 702)(1 - .75*) 

65 - 70 X .80 
\/(l - .70*)(1 - .80*) 

.60 - 75 X .80 
V(1 - .75*)(1 - .80*) 

■70 - .50 X .75 
V(1 - .50*)(1 - .75*) 

70 - 65 X .80 
V{1 - .65*)(1 - .80‘) 

.75 - 50 X .70 
V(1 - .50*)(1 - .70*) 

■75 - .60 X .80 

Vd - .60*)(1 - .80*) 


-.053 

.210 

.000 

.567 

.395 

647 

.563 
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Tri-B = 


Tin-p = 


.80 - ,65 X .70 
V(1 - .65*) (1 - .70*) 
.80 - .60 X .75 
V(1 - .60*) (1 - .75“) 


= .636 


= . 661 . 


From the complete set of first-order coefficients given above 
those of the second order may be found as shown below. Each 
has been found by the two possible formulae and the slight dis- 
crepancies m the results are due to the fact that not enough 
decimal places were carried to insure accuracy to three places. 

181 - 395 X 563 


TliPRI = 


THP IR 


thr pi = 


IHRIP = 


Tni RP = 


IHI PR = 


v^(l - .3952;(1 - .563^) 
- 053 - 210 X 000 


V(i - ^lo^Td - 000^) 
505 - 56 7 X .661 
V(1 - 567^)(1 - mV) 
21 0 - ( - 053 X 000) 
VCl - 053^)(1 - 000=') 

39 5 - 1 81 X 5f);3 

V(ir^r8r*)(l - 563=) 
567 — 505 X .661 


IPR HI = 


TPRIH = 


rpi HR = 


rpiRH = 


TRJ HP = 


,505-Xl — 

.6610 

- 1)47 X 

636 

647^)(1 - 

.6360 

(- 053 X 

210) 

0530(1 - 

.2100 

- 418 X . 

636 


vTl - 418'H1 - .636») 
.563 - 181 X .395 
V(1 - .181*) (1 - .395*) 
.636 - 418 X .647 


= — .055, or 


= -.054 


.211, or 


= .210 


= 361, or 


361 


= on, or 


.011 


= .544, or 


Vll - .418^) (1 - .647*) 


= .544 


= 528, or 
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TrIPH = 


.661 - .505 X .567 
V(1 - .505*)(1 - .567») 


.527. 


The fonnulse for partial coefficients of correlation involving 
five variables, or, in other words, of the third order, may be 
illustrated by the following examples for the correlation of 1 and 
2 with 3, 4, and 5 constant 


ri 2 . 34 t or r 12.431, 


ri 2 34 — ri 5 34 r as 34 

'“itaiKl ~ ^2534) 


ri2 14 — rii, •(4‘r2B 34 

34 ^'26 34 


ri2.s64 or ri 2 534 


1 12 36 ~ ri4 36 r24 36 


V(1 


6)(1 ^24 33 ) 


, or 


ri2 36 ~ ri4 36 ^24 36 


U4 36 '>24 36 


Tj 2 46 — r |3 4 6 ? 2i 46 

r„.463 or rn 643 = VlT- r?3 46)(1 - 

ri2 46 ~ ri3 43 r23 45 
^‘n 45 ^23 46 

These show that there are three possible ways of computing 
each such coefficient. If enough decimal places are earned the 
results agree. The three subscripts after the pomt, that is, those 
of the three vanables held constant, can be arranged in six 
differait ways, but the order of the first two of the three may be 
reversed witliout affecting the formula!. Just as and j ’21 are 
identical, so are ri 2.346 and ri 2 . 436 , etc. There are corresponding 
sets of formula for the partial correlation of 1 and 3 with 2, 4, 
and 5 held constant ; 1 and 4 with 2, 3, and 5 held constant ; and 
so on for each possible grouping of the variables. 

Since the computation of coefficients of partial correlation 
requires many, and in some cases all, of tlie jiossible Correlations 
among the several vanables concerned, it often saves time and 
labor in computation to make use of the form for the inter- 
correlations of several vanables shown in Table XLI (page 174). 
Because of the economy of computation possible by using the 
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form shown in this table, it is probably advisable, in cases where 
the intercorrelations between several variables are to be found, 
to use this form for a somewhat larger number of cases than 
would ordinarily justify the computation of correlation from 
data in column rather than tabular form. Certainly up to fifty 
and, if the number of intercorrelations is quite large, probably 
up to seventy-five or one hundred cases may well be handled in 
this manner 

If one wishes to compute a large number of partial coefficients 
of correlation it is advisable to become familiar with certain 
suggested dences that may be used in this computation Among 
these, two appi'ar ('spi'cially worthy of mention One is a set of 
tables by Kelley,^ v\ hich facilitate computation, and the other a 
suggestion by Hull * in which he mentions two possible methods 
for applying the dtwices which he proposes. 

In case one desires to compute partial coefficients of correla- 
tion of the second or higher oiders, that i.s, involving four or more 
variables, it is helpful to organize the work in a form such as has 
been suggested b\ ‘'Cieral .'-tatisticians The most usual form 
may be found in eithei Yule ^ or Holzinger,^ but will not be 
described here, .'«ineo eonqiaratnely few elementary workers in 
the field have occasion to employ it Franzen and Derrj’berry * 
have organized this into a mechanical routine easy to follow. 
Bathurst ^ ha.s .suggested a somewhat different plan, which m 

•Truman L Kt’llio “Tal>li's to FacilitaU' the Calculation of Partial 
Coefficients of Correl.ition anil Regn'ssion EliiUiitKms,” Bulletin of the 
Unwermty of Tej:a.s, No '27 ( \uHtin, University of Tev.is 1916) 

, “Chart to l-’aeiht.ite the Calculation of I’lu-tial Qpefficients of 

Correlation anil Regrev.>iou Knuations’’ (.Stanfonf Univ'erBity, Califonua, 
Stanford Uuiversitv, 1921) 

• C L Hull, “A Device for Deti-rmining Coeffieienta of Partial Correla- 
tion,” Pbi/choloffical Review, \ ol 28. lse|)temlx'r, 1921, iip 377-383 

‘ G Udny Yule, An Intioduetion to the Theory of Stati^tia, ninth edition, 
revised (London, Charles Griffin A: Co , 1929), pp 23'), 242-243 

• Karl .1 Holzinger, Btati'iHral Methods for Btudent* in Education (Boaton, 
Ginn & Co., l'J28), pp 290-291 

'Raymond Franzen and Mahew Derryliorr>, “The Routine Computa- 
tion of Partial and Multiple Correlation,” Jmirnal of Educational Psy- 
chology, Vol 22, Decemlier, 1931, pp 041-651 

’ J F) Bathurst, “A Partial Correlation Scheme,” Journal of AppUed 
Psychology, Vol. 11, April, 1927, pp 155- 164. 
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some respects is more elaborate, but at the same time requires 
less work to secure the final desired coefficients. A convenient 
method of computing partial coefficients by a variation of the 
usual formula has been suggested by Peters and Wykes * Like- 
wise it will probably be helpful to workers to familiarize them- 
selves with Symonds ’ partial- and multiple-correlation charts. 
A graphic method for computing partial-correlation coefficients 
has been suggested by Wood.*" 

If coefficients of multiple correlation, which will bt* discussed 
in the next chapter, have already been detenmned, another 
formula than that already given for coefficients of partial cor- 
relation IS much easier to use It i.s as follows 


ri2 34 . . n 



1 — h*! 234 n 

1 ~ fill 23 . (n - I) 


It is sometimes useful for rough checking and other purposes 
to know the coefficients of partial correlation that rc'sult from 
zero-order coefficients of certain sizes. With this m mind 
Table LVI has been prepared It shows the values of partial 
coefficients of correlation for from three uji to eight variables 
based upon zero-order coefficients of correlation all of which are 
of equal size. The first column m the tabic gives the sizes of the 
zero-order coefficients, and the following six columns thos<‘ of the 
partial coefficients for from three to eight vanables, that is, 
from the first to the sixth ordiT, respectively. The first row of the 
table indicates that if the zero-order r’s between all pairs of three 
or more vanables are all 1.00, the partial coefficients are in- 


• Charles C Peters and Elizai)eth C Wykes, “Simplified Methods for 
Computing Regression Coefficients and Multiple and Partial Ctirrelations,” 
Journal of Educalumal Research, Vol ‘2i, June, 1931, pp 44 -.'52 
’Percival M. Symonds, “Joli- Analysis Sheet for Computing Partial 
and Multiple Coefficients of Correlation and Regression Coefficients,” 
Teachers College Record, Vol 27, Septemlx.*", 192.'), pp .'>2-69 

, “Symonds Partial- and Multiple-Correlation Chart" (New Y'ork, 

Bureau of Publications, Teachers College, Columbia University). 

“Ernest Richard Wood, “A Graphic Method of Obtaining the Partial- 
Correlation Coefficients and the Partial-Regression Coefficients of Three 
or More V'ariables,” Supplementary Educational Monographs, No 37 
(Chicago, University of Chicago, January, 1931), 72 pp 
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determinate. This results from the fact that the first-order 

coefficients equal ^ The second row of the table shows that if 

the zero-order intercorrelations among the variables are aU .90, 
the first-order partials are .474, the second-order partials .322, 
and so on to those of the sixth order, which are .141. For all 
positive values of zero-order r, all resulting partial r's are posi- 
tive, and for all negative values they are negative. The table 
ends at a value of — .50 for zero-order r, because it is impossible 
to have a larger negative correlation than this between each 
pair of three variables. 


TABLE LVI 

RjCLATIONSnlP BETWEEN SiZE OF ZeRO-ORDKR COEFFICIENTS OF 
Correlation \nd of Partial Coefficie.nts Based Thereon 


Zero 

Order 

r't 

First 

Order 

r’s 

Second 

Order 

r's 

Third 

Order 

r’s 



Sixth 

Order 

r’t 

1.00 

• 



— 

— 




.90 

.474 

322 

244 

196 

164 

141 

.80 

44-1 

307 

235 

190 

160 

.138 

.70 

412 

202 

226 

184 

.155 

.131 

.60 

.375 

273 

214 


150 

.130 

.50 

333 

250 



143 

125 

.40 

286 

i ■>o-> 

.182 

1.54 I 

133 

.117 

.30 

.231 

188 

158 

136 

120 

.107 

.20 

167 

143 

125 

111 

100 

.091 

.10 

091 

083 

077 

071 

066 

.062 

.00 

000 

(KK) 

(too 

000 

000 

.000 

-.10 

- .Ill 

- 12.5 

- 143 

- 167 

-.200 

-.250 

- 20 

- 250 

- 333 

- 500 ’ 

-1 000 

— 

— 

-.30 

- 429 

- 751 

— 

— 

— 

— 

-.40 

- 667 

— 

— 

— 

— 

— 

-.50 

-1 000 

- 

' — 

— 

— 

— 


* — indictiteti that the Aalueof the imti'uI roef&ripnt of corr«lati<m tsiireapondmc to Um 
given eero-urdtr (.oeftinoni ih I'lthi'r in>lei('rt7uuate or that it u piipoasubie to have too Uldi* 
OAtod Mpoordor cooflicient > lu'h pair of the in«licatod utitulier of vanables- 


Part correlation. Two varieties of correlation quite sim- 
ilar to one another and also resembling partial correlation in 
many ways are part correlation and semi-partial correUUton, 
These have so far received httle use in educational work but 
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seem to merit more frequent employment. The first of these, 
the coefficient of part correlation, measures the remaming 
correlation between two variables after eliinmating the partial 
correlations of one of them with the third and as many others 
as are concerned while the second is hi'ld constant. Thus the 
part correlation between intelligence-tc'st scores and av'erage 
school marks, when reading and arithmetic scores are also con- 
cerned, is the correlation remaining hid ween intelligence scores 
and average marks after eliimnating the part ial correlations of 
intelligence scores with reading and arithmetic scores, while 
average marks arc kept constant 

The symbol used for coefficients of part comdation is the 
same as that for ccK'fficients of partial correlation except that 
instead of writing the sub.scnpts of the two variables correlated 
immediately after r tht‘y are written before it, that is, to its 
left. Thus the generahzcal sviiibol foi a coefficKmt of part cor- 
relation is i2r34 . . . „ This symbol st.iiids for the correlation of 
variable 1 with variable 2 when the [lartial correlations of va- 
riable 1 with variables 3, 4, and so on, while variable 2 has been 
held constant, are eliminated 

If coefficients of multiple correlation and regression, which 
will be descnbed in the next two chapters, have already been 
found it is relatively easy to compute coefficients of part cor- 
relation The general formula is 


h i; 84 . . nO'2 

12 34 ... n J 

In this formula 612.34 . n is the coefficient of partial or multiple 
regression explained in Chapter XVTI and /C 234 ... „ is the 
co^cient of multiple correlation explained m Chapter XVI. 
In connection with this fonnula the reader should note that al- 
though the order of the first two subscripts of coefficients of 
partial correlation is not significant, the order of the same sub- 
scripts of coefficients of part correlation and also of the partial- 
regression coefficients employed m the formula is significant. 
In other words, ri 2 .n . . , is the same as r2i.84 . . but i2ri4 . . 
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is not the same as 2ir34 . . . nor is {>12.34 ...» the same as 

bsi-ti . . .n- 

To illustrate the computation of coefficients of part correlation 
the same data already employed for those of partial correlation 
may be used. Substituting m the formula the proper values 
obtained by the methods described in Chapters XVI and XVII, 
the following results are obtained: 


^ 6 

22y2^()^4^82(l - 

143 

v' X 617^) 

437 X 10 

” V' 137- X 10- F8-(.r^W)~ 

r =. 

,).s3= X~S^“ +^^10^1-^ •723*7 

2S(5_XJ0 

N '28(i-' X 10*'+ir=Cl~7i7l7*r 

011X6 

v'uic X 6-’ + rb*(r- 723 -7 


224 

236 


590 


.559 

.518 

.469 


Each of the.se is larger than the corn^spondinp coefficient of par- 
tial correlation. For further discussion of coefficients of part 
correlation the reader t-. referred to Ezekiel " and a mimeo- 
graphed pamphlet bv Smith and Ezekiel 

Semi-partial correlation. Semi-part lal correlation is best 
prestmled m an article h> IHinlap and Cureton ” They deal with 
SIX chief tyiK's of correlation of which semi-jiartial correlation is 


*’ Mordcc.n Eickirl, Melhfxh of Comlnttori Attainsis (New York, John 
Wiley & Soiib, 1930), p|> ISl IStt. 379-3.S0 
'* R B Smith and Mordeeiii I ./ekiel, ''Correhitien Theor>’ and Method 
Applied to Afpricultural Re.-.carrh, ’ ininieoizniplu'd [lubhcation, Buioau 
of Agricultural Economics, t’ S Dept of .Agriculture, August, 1926, pp. 
67-60 

“ Jack W Dunlap and Eklward E Cureton, ‘‘ On the .Analysis of Causa- 
tion,” Journal of Educational Psychology, Vol 21, December, 1930, pp. 
657-680. 
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one. It differs from part correlation m that the correlations of 
the first variable with the third and others that are removed 
from the correlation of the first and the second are not partial 
correlations in which the second is held constant, but do not 
involve the second at all, that is, they are computed just as 
if the second variable did not exist . A coefficient of semi-partial 
correlation measures the reniaminj; rectilinear relationship of 
one variable with another after the relationship of the first 
variable with the third and any other variables concerned, but 
not with the second, has been eliminated Thus, for example, 
m the case in which intelhf;ence-test scores, reading-test scores, 
arithmetic-test scores, and general school average arc concerned 
one may find the semi-partial eorndation of intelligence scores 
with average marks after the corrida! ions of intelligence scores 
with reading scores and arithmetic scores have been eliminated. 
For three vanables only the fonnula for semi-part lal is much 
Bke that for partial correlation, the difference being that one 
of the expressions under the radical in the denominator dis- 
appears. Thus, the correlation between that part of variable 1 
unoorrelated with variable 3 and all of variable 2 may be ob- 
tained by the formula 


I'll ~ ru rja 
r(i 3)2 - ■ 

V 1 - r?3 

If this formula is apphed to the same data used earlier in the 
chapter to illustrate the computation of the coefficient of partial 
correlation, the following results arc obtained . 


r{p.B)R 


50 - 

65 X 60 

Vl 

- .65’ 

65 - 

50 X .60 

VT 

- .50’ 

60 - 

.50 X .65 


- .50* 

*0 - 

.60 X .65 

vr 

- .60* 


= .145 

= .404 

- .318 

= .138 


r(P-R)B = 
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r(R.n)p 


■60 - .65 X .50 
Vl - .65* 




65 - .60 X .50 
VI - .60* 


.362 

.438. 


It will be observed that each of these values is smaller than the 
correspondinR one for partial correlation, given on page 264. 
The general fonnula for any numb<>r of variables is 


r(i.84 


ro 4 

n)2 = 

I'd 4 


r.)2 — ri3 4 


rt'TiZ 4 


nI2 


Vl - 

n)2 ~ Tu 4 


ri3 4 


-.or 


n rci 4 . 


n)2 


Of the other five types listed by Cureton and Dunlap three are 
fairly common One is ordinary partial correlation, a second is 
that iK’tween the part of one variable uncorrelated with another 
and all of the first variable, or the relationship measured by the 
coefficient of alienation, a third always equals zero, being that 
m which the correlation between the part of variable 1 un- 
correlated with variable 2 and all of variable 2 is concerned. 
The two other types are of less frequent occurrence. They are 
that in which it is do, si rod to find the correlation between that 
part of variable 1 uncorrelated with vanables 3 and 4, and that 
part of variable 2 uncorrelated with variable 3; and that m 
which the correlation is desired between that part of variable 1 
uncorrelated with variable 3 and that part of variable 2 un- 
correlated with variable 4 For fuller discussions of all of these 
types, including derivation of the desired fonnulse and discussitm 
of the relationship betwwii the different types, the reader should *" 
see the discussion already referred to and also a short article by 
Franzen ** that di'als with certain phases of the subject. 

Other methods s imilar to partial correlation. In addition to 
coefficients of partial correlation, certain other methods designed 
to accomplish the seme, or approximately the same, ends have 
been suggested and are sometimes e|^|ployed. Although the use 

“Raymond Franzen, “A Comment on Partial Correlation," Journal 
aj Educational Payeholoi/y, Vol 19, March, 1928, pp 194-197. 
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of these is increasing, it does not appear to the writer that they 
are of sufficient importance to the ordinary user of educational 
statistical methods to be dealt with at length in this volume. 

One of the methods referred to is that of 'palh coeffixnenis. A 
path coefficient is equivalent to a /8 coefficient such as is men- 
tioned on page 245, and may be defined as the ratio of the stand- 
ard deviation of that part of a variable due to a particular cause 
to the total standard deviation of the variable Thus if X is the 
variable under consideration and Z is the cause concerned, the 
path coefficient beiwecn A' and Z is equal to the standard 
deviation of that part of X caused by Z dividi'd by the total 
standard deviation of A’ Siiici', as alnaidy stated, the ratio of 
these two standard deviations equals the coefficient of correla- 
tion when only two variables aie involved, the palh coefficient 
between two variables is the same as thi' ciK'fficii'nt of correla- 
tion. When more than two variabU's are involved the coefficient 
of correlation between any pair of them may be obtained from 
the various path coefficients The geni'ral purpose of the method 
of path coefficients is to detemiine amounts of causation of one 
variable by one or more othi-rs To do this one must assume the 
direction of causation between each possible pair of variables, 
and ID comparatively few casi's can this assumption be known 
to be fully valid This fact constitutes a serious limitation upon 
the use of the method. Moreo\er, path coefficients are accurate 
and valid only when the independent variables contribute them- 
selves completely, that is, are component elements of thi' depend- 
ent variables Otherwise, jiath coefficients an' only best esti- 
mates of the relationships existing and may not approximate the 
true relationships clo.soly Finally, they assume rc'ctilincar 
relationship and homoscedastic arrays, and the absence of these 
conditions is not uncommon For more complete discussions of 
path coefficients, the reader is rehrred to Wright,^* Niles,** 

“Sewall Wnght, “Correlation and Causation,” Jnumal of Agncuhural 
Restarch, Voi 20, January, 1021, pp 557-5H5, al'io, “The Theory of Path 
Coefficients — A ^ply to Niles’ Cnticwm,” Genehce, Vol 8, May, 1923 
pp. 238-2.55- 

“H. E Niles, “Correlation, Causation, and Wright’s Theory of 'Path 
Co^ciente,’ ” Geneltca, Vol. 7, May, 1922, pp. 2.58-273; also, "The Method 
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Burks," Kelly, “ Tryon," Heilman,* and Dunlap and Cureton.” 
Another of the methods is that of determinants, which has been 
explained by Kelley and others. 

Holzinger has suRRested a method of ehminating the effect 
of a third variable, which differs from that of partial correlation. 
This method provides for correcting the values of the two 
variables between which the correlation is desired for the cor- 
responding valui's of the third It possi'sses the advantage that 
whereas partial correlalion is basi-d upon simple correlation, 
which IS rectilinear, and, therefore, is dsi’lf rectilinear, this 
method takes account of curvilinear ndationship as well, and 
thus more nearly ini'asures the complete relationship existmg. 
McCloy ha.s also dealt with the accomplishment of the same 
result McCoimick has suggested what he calls “a coi'fficient 
of independent determination ” It applies to a situation m- 
volving three or mon- variables in a way similar to that of r* 

of Path Coefficitnt> An Answer to Wright," Genetics, Vol. 8, May, 1923, 
pp 256-200 

” Itarliara Stoddard Huik^, "On the Inadequacy of the Partial and 
Multiple Correlation Teehni(|iie,” Journal of Etlucatumal Psychology, Vol. 
17, Novomlxr, Dceetnln'r, I'.Uti, pp 532-540, 62 >-630 
1* E Ixiwell Kelly, ‘ The Relationship lietween the Techniques of Par- 
tial Correlation and Path CiK'fheienta, ’ Journal of Kducaltorud Psychology, 
Vol 20, Kehniarv, 102'), pp 119-124 

” Rol>ert Choate Tr\<m, ' The tntcriiretation of the Correlation Coeffi- 
cient,” Psychological llioic, \ <>1 3(i, ,'Septemlx-r, l')2'), jip 419^445 

“ J D Hediiiiin, "1 artoix Detenniiuiig .\chicvemeiit and Grade Loca- 
tion," Pcrlayoytial Scminarii awl Journal of Genetic Psi/Jioloyy, Vol. 36, 
Septemlier, 1929, [ip 43.5- t57 

Jack W Dunlap luid Edward K Curcton, "On the .Analvsis of Causa- 
tion," Journal of Educalumal Psychology, Vol 21, Deceinlier, 1930, pp. 
672-676. 

Truman L Kellev, Statist teal Mrlhod (New 5'ork:, Macmillan Co., 
1923), pp 29.5-302 

••Karl J Holzinger, StaUslicol Methods far .Studcnls in Education (Bos- 
ton, Ginn A Co , 19281, pp ISl ISt) 

•• C H McCloj, ‘ A Method of Computing Partial Correlation and 
Regression Equations with \anahlcs Having Curvilinear Intercorrela- 
tions," Journal of Educational Kcstarch, Vol 16, Noveuiter, 1927, pp 285 - 
295 . 

“Thomas C McConnick, ‘‘A Coefficient of Independent Determina- 
tion,” Journal of the American Statistical Assoctalion, Vol. 29, March, 
1984 , pp 70-78. 
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with two, showing what per cent of the total variation in the 
dependent variable is associated with each independent one. 

Interpretation. In connection with partial correlation the 
same point made in connection with simple correlation should 
be emphEisized . that the factors eliminated by partial correlation 
cannot safely be regarded as causal factors unless there is other 
evidence available to indicate that they bear this relationship 
to the others. All that it is safe to say is that they are common 
factors. They may be causes or there may be common causes 
that produce them and also the other factors concerned It is 
even more true in the case of coefficients of partial correlation 
than of those of simple correlation that one must be guarded 
in their interpretation Not only is it unsafe to assume a causal 
relationship between variables for which the partial coefficients 
are relatively high, but also still other limitations hold in inter- 
pretation. It has been shown by Burks, Hull,” and others that 
iof the probably four main types of patterns that represent the 
intercorrelations of variables concerned in a partial correlation 
only one type justifies the interpretation commonly given a 
partial coefficient. That i.s to say, there is only one type m 
which the two vanables are actually freed from all their factors 
in common with a third variable that is supposed to have been 
rendered constant or eliminated This type is that in wffiich the 
third vanable contains only one factor or a unified group 
of factors msofar as the other two vanabk's are concerned. 
Another way of stating this is to say that th(‘ factor introduced 
by the third vanable munt operate in the same way on the two 
vanables between which the partial correlation is being deter- 
mined. The case may be desenbed somewhat more tcchmcally 
by saying that the third variable must be a component of the 
other two, that is, contnbute itself completely to them. As an 
example of this we may take the case of partial correlation 
between French and Spanish with Latin rendered constant. 

“Barbara Stoddard Burks, "On the Inadequacy of the Partial and 
Multiple Correlation Technique,” Journal of Educaliorud Ptychology, 
Vol 17, November, Decenilier, 1926, pp 632-640, C2.')-630. 

“ Cl^k L. Hull, Apltiude Tethng (Yonkers-ou-Hudson, World ^ook Co 
1928), pp. 260-253 



PARTIAL CORRELATION 


279 


It is only in case Latin acts as a unitary factor or in the same 
way on both French and Spanish that the resulting partial 
correlation really descnbes the relationship between the elements 
in French and Spanish that are not contamed in Latin. As a 
matter of fact, it is probable that Latm contains a number of 
factors, such as vocabulary, grammatical relationships, habits 
of thought, and so forth, that act more or less mdependently 
upon French and Spanish and, therefore, that the elements 
common to these two languages and Latin do not operate upon 
the two uniformly or as a single factor. 

Another unportant fact is that if one or both of the variables 
whose ni't correlation is desired are not merely effects, but also 
causes, of the variable or variables partialed out, the partial- 
correlation technuiue partials out too much In such cases the 
partial correlation coefficient is less than the true amount of 
correlation remaining afU'r eliminating t he effects of the variable 
or variables denoted by the subscnpts of partial r following the 
point. 

Among others, May “ has pointed out limitations of the 
coefficient of partial correlation. Some of these are that for 
certain purposes at least it partials out too much , that it assumes 
rectilmeanty, and that it cannot be used unless the thmg that 
18 to be partialed out can be expressed quantitatively, in other 
words, is a variable rather than an attribute. He suggests that 
these limitations be avoided by using a more general formula of 
which that employed for partial correlation is a special case. 
This formula gives the correlation between two variables when 
the deviations are taken from means of homogeneous sub- 
groups into which the total distributions art* divided rather than 
from the two means of the total distributions. It is as follows: 

V<tI - - <ri., 

In this ris, Ci, and <Tj are the ordinary coefficient of correlation 

"Mark A May, ‘'A Method for Correcting Coefficienta of Correla- 
tteiM fo#. Heterogeneity in the Data," Journal of Educattomd PiycAoiogy, 
Vol. 20, September, 1929, pp 417-423 
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and standard deviations of the total distributions, whereas those 
to which the subscript m is attached are those of the means of 
the subgroups, each mean being weighted by the corresponding 
number of cases in the computation of r. 

As is evident from the formula, this method requires the 
division of the data mto a numbi r of relatively homogeneous 
subgroups, the determination of the mean of each variable for 
each subgroup, and the computation of the standard deviations 
and the coefficient of correlation for the distribution of means 
and also for the total distributions The chief point of difficulty 
m employing this seems to be in making the di\ ision into rela- 
tively homogeneous subgroups If the basis upon which ho- 
mogeneity IS determined is a variable, it is Inghly improbable 
that truly homogeneous groups can be formed (hmerally the 
best that can be done is to adofit a certain relatividy ri'Stricted 
distance or amount as the rangi* for each subgroup Thus, for 
example, if it is desired that the gioups be homogeneous on the 
basis of age, each may contain pupils whow' ages fall within a 
given SIX months, year, or some other range, if in intelligence 
quotient, withm a range of perhaps fivi* points, and so on in other 
cases. 

Among the advantages claimed for this method are that it 
can be employed w'hen the heterogeneous factors concerned are 
attnbutes and not variables, that it d(K>s not assume rectilm- 
earity; that it renders possible the handling of any number of 
heterogeneous factors in one opeiation, that is, in the formation 
of the subgroups; that it may call attention to certain peculiar- 
ities m the data such as that one subgroup diffiTs distinctly 
from the others m one of its variables, that by fonning sub- 
groups on differellft bases it pi-niiits more thorough mtc'riirotation 
of the data, and that by solving the fonniila for 1,2 and r„ „ 
certain other relationshijis may lx* brought out 'riie measure 
obtained by this formula is th<* average weighted correlation 
between the two variables concerned for the several homoge- 
neous or near homogeneous groups ink) which they are divided 
aiKl thus differs from the ordinary coefficient of partial co |7f l q- 
tfen, which measures their correlation when all are thrown into 
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one group but with the influence of the factor that forms the 
basis of the homogeneous grouping eluninated. 

The reader who is interested m going further into the meaning 
of partial correlation should consult the article by Dunlap and 
Cureton ^ 

The ratio of partial correlation. Although it is rarely em- 
ployed, there is a ratio of partial correlation that may be used 
to measure partial ciinolmear relationship. The formula for 
it requires that the ratio of multiple correlation, mentioned in 
the next chapter, be lust computed For three variables the 
formula is 



which may also be written 



For the general formula and a fuller discussion of its use, the 
reader is referred to Kielz *’ and Ezekiel 


ExJEKCIbES 

1. Compute all jHis-sihlp popflioionts of partial corrplation for each of 
the following sets of zcro-iinlpr coelhcicnts: 

A ri2 = .74, Tij = fUi, ;j3 = 48. 

B. tab = -821, TAC = 7tl4, ) ID = .773, ibc = 648, Tbd = -452, 
TcD = t’>85. 

C rxr = 94, rxz — 89, m'z = 92. 

2. Compute the cocfficiente ol partial eonrelatioa for the following 
data 19-19-15, 18-18-17, 10-1.3-12, 19-13-11. 17-19-16, 14-14-12, 

•• Jack W. Dunla|) and Edward E Cureton, "On the .Analysis of Causa- 
tion,” op rtf., pp 652-680. 

" H L Rietz and others, //aiu/fvwl of Mathematical Statiatux (Boston, 
Houghton Mitllui Co., 1924), pp 146-149 

’* Mordecai Ezekiel, "A Method of Handling Curvilinear Correlation 
for Axy Number of V'anables,” Journal of the American Stalxsltcal AMOcfB- 
tion, 'WB. 19, December, 1924, pp. 431-4M. 



282 STATISTICAL METHOD IN EDUCATION 

13-1&-6, 17-11-5, 17-14-13, 12-9-17, 11-13-4, 14-12-10, 12-16-16, 
13-10-18, 10-10-3, 0-9-11, 10-10-3, 10-9-2, 11-12-6, 12-14-16, 
7-7-17, 8-8-5, 6-8-2, 5-9-1, 7-7-13, 6-5-9, 6-10-2, 4-5-5, 3-6-2, 
3-2-8, 2-4-0, 3-4^3, 2-7-5, 1-4-0, 1-0-3. 

3. Compute the coefficients of semi-partial correlation for the data 
in A and C of Exercise 1. 



CHAPTER XVI 

MTTLTIPLE CORRELATION 

Purpose and meaning. Multiple correlation is the correlation 
between one variable and the combined values of two or more 
others. It is m a sense exactly the opposite of partial correlar 
tion, which 18 inhnded to free the relationship of one variable 
with another from that of Ixith with other variables For exam- 
ple, if pupils’ high-scliool marks have been correlated with their 
elementary-schcMil marks and mtelligence- and achievement- 
test scores, it is possible by means of the methods of multiple 
correlation to si'cure a single coefficient of correlation between 
their high-school maiks and the other three combined Thus 
the result accomplished is the same as if high-school marks 
were correlated with the best possible combmation of the other 
three marks By “best possible” is meant that which yields 
the highest correlation Multiple coefficients are based upon 
ordmary coefficients of correlation and therefore are likewise 
rectihnear m their nature 

Computation of coefficients of multiple correlation. Although, 

as just stated, the cwfficient of multiple correlation is based 
upon simple coefficients of correlation, the formula generally 
used m securing it includes partial coefficients also The gen- 
erahzcd formula is 

Bij 34 . n= v'l-(l-r?j)(l-r'fj 5 )(l— (»- i)) 

or y/l — ^'^3 2 k\^ 23 • • (n- 1) 

In this the subscript of R, 1 534 • . . n, indicates that it is the 
correlation of variable 1 with \anables 5, 3, 4 ■ • n. In other 
words, the, symbol before the point indicates the one variable 
that is correlated with two or more others and the s}rmbolB 
which appear after it indicate those with which it is correlated. 
Sometimes the subscript is written 1(2S4 ■ • n), which meam 
just the same as the more usual way previously given. 
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In the case of the coefficient of multiple correlation, as in 
that of partial correlation, it is possible to compute its value 
in more than one way by merely rearranging the symbols fol- 
lowing the point It is immaterial in what order they appear. 
For example, instead of J34 . . , n we may write Ri.tn . . . n, 
which gives the formula 

Vl - (1 - r?3)(l - 3)(1 - 23) ... (1 - 

or we may substitute fli.432 which gives 


Vl — (1 - 4){1 - (1 - rLas . . ■ (n-i)) 

and so on The results from thc'sp jin' the same. 

Smce partial coefficients of correlation are derived from 
simple coefficients, the fonnula (riven above can be expressed 
entirely m simple coefficients This is commonly done if there 
are only three variables involved, and .sometimes if there are 
four, but if there are fi\'c or more the re.sulting fonnula? become 
so long that they are practically never employed. For three 
variables the formula in tenns of zero-order r’s is 


12 fia ~ 2ri trial's 


p . / ' I2 "r t',3 zr 


,or 


+ rja — 2ri2ri 3r;3 


In this the first two r’s in t he numerator have subscripts formed 
by combinmg the first subscript of Ji with the second and with 
the third, respectively The last three r’s in the numerator 
represent all three possible combinations of the subscnpts, 
that is, the same as were u.sed in the first two and also the one 
formed from the last two subscnpts of R The single r in the 
denominator has the same subscnpts as the last two of R. 

For four variables the formula for the multiple correlation 
of one with the other three is sometimes given m terms of first- 
order r’g, that IS, of partial coefficients m which one lactor is 
held constant, as foUow's . 
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Rvtu = 


- (1 - ~ ~ 


^34 2 ~l~ 2ri3.2*rj4.gT^a^ 


It is usually preferable to use the form taken directly from 
the general formula given near the first of this section. This is 

Ri *84 = Vl - (1 - rfj)(l - rj 32 )(l - rf 4 jj), or 


,/l _ 1-2 J,2 12 

V 1 12 ^ 13 2 14-23 

By changing the order of the three subscnpts after the point, 
the following five formulie, which give the same result as the 
one just giv(‘n, may he obtained 

Ri 243 = Vl - (I - r? 2 )(l - - rfjjJ.or 

Ri 824 = Vl - (1 - rfalCl - 'i2 3)(l - ’ll 23)1 or 


VI'- A]:ii,A?4i 


Ri.ui = Vl - (1 - Ii 3 )(l - r?, 3)(1 - rfs 34 ),or 


V 1 Aij Afj -j A ,2 s4 

’ll HI ~ ’^2 4 ) 1.1 ’is 24)1 or 


1 423 — Vl — I'l 

Vl ~ f'u f'h 4 Ai3 24 

^2i.432 = V'^1 


(1 ’“iKl ’fsilCl ~ ’’i;234l,or 


Vl Aj 4 Aj 3 4 Aj 2 34 


Commonly some two of these are employed for purposes of 
checkmg the correctness of the result 

The calculation of cix'fiicients of multiple correlation may 
be illustnited by using the .same data as for partial correlation. 
Using only the three variables first mentioned (history, physi- 
ology, and reading), w'e h:i\e 


Rhpr = 
Rp-bm ~ 




50"- -f .05* 


50* + .60* 


- 2 X .50 X 65 X 60 
1 - 60* 

- 2 X 50 X 60 X 65 
■ 1 - 65* 


= .664 
= .617, and 
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„ _ , /.65* + .60* - 2 X .50 X .60 X .65 _ 79 , 

ttR HP - y 1 _ . 50 ^ 


It may be seen from these coefficients that when r is fairly 
high the calculation of multiple R involving other r’s of about 
the same size as the first one does not greatly increase the 
amount of correlation pri'sent If the first r is much smaller 
than the others, the increase becomes much greater The 
nearer the original r is to 1 00 the less does the introduction of 
other correlations increase the amount 

For the four vanables, that is, the three above, and also 
intelligence, the coefficients of multiple correlation are given 
by the following formuhe, each of which involve one simple 
or zero-order, one first-cirder, and one second-order coefficient 
already found in the last chapter. 


Rphir = VI - (1 - SO-ld - 6472)(1 - .OIP) = .751 

Rrhtp = Vl - (1 - - 63f)i')(l - .OIP) = .810 

Rhipr = Vl - (!’- 70=)(1 - ^^53'')(1 - .2U~) = .717 

Ri-hpr = Vl - (1 - 702j(l - .fr47^)(l - .528*) = .887. 

These may be checked by using any one of the other five 
possible formulae for each Thus, for example, 

Rprhi = Vl - (1 - fiO^Td - ISPJd'- . 5442 ) = 751 
Rr phi = Vl - (1 - wj^yrr- 505*) d - 528*) = 810 
Rh rjp = Vl - (1 - ffir’Kl - 395 "') (1 - ^5^) = .717 

Ri rbp = Vl - (1 - .80'K1 - .395')Ti - .544“) = .887. 


Instead of using these or any of the six variations of the 
formula, one may mstcad employ the form given on page 285, 
which does not require s(*cond-order coefficients. The same 
results are obtained, as follows. 


i-(i- 


647'- 418'- eJ0>+2X 647X 418X 636\ 
I - 636* ) 


636>- 418*- 547* f2 X 836 X 418 X 047 1 

1 - 647* , 


761 

.810 
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HjUPR-l/ l'a-70*)(i 


- 0»3«- 210»- 000«+2X(- 0S3)X 210 X 000 ^ 

1 - 000 » ) 

- M7»- 636*- 418 ‘ -)-2X«47 X 638 X 41g \ 

1 - 418> } " • 


Each of these may also be written m six ways, but they 
result m only three vanations of the formula when substitu- 
tions are actually made Thus, for the first one just given we 
obtain the same substitution whether we arrange the subscripts 
lip HiR or Up HRi Likewise Rp mu and Rp jpn are the same and 
also Rp am and Rp.Rm- All yield the result already obtamed, 
. 751 . 

For multiple correlation formulse for more than four vari- 
ables the same gimiTal rule may be applied with slight addi- 
tions. It will not be given here in full The formula for five va- 
riables 18 

Ri-tui — Vl ~ ( 1 ~ r'; 5 )(l — r *3 j)(l — 7^4 mKI — ** 4 ), or 

vi ~ ^'12 

This may also be writt^m chiefly in terms of second-order coeffi- 
cients, thus 


|/l -(1 -rl,)(l 


-a rjt + 2 rn 11 ru-t»-r«t i» \. 

1 - „ / 


This IS the same as each of the following R\ 23 ^ 4 , Ri-utt, 

Rl 1453, Rl 2634, Rl 2643. R\ 3216, Rl 3261, R\ 3426. R\ 3462, Rl.$it*l 

3542, 1^1 4235, 1 4263, /ll I 4126. I?14362, I 4623. 1^1 4532, Rl-Ult, 

Ri-ins, Rl 5324, Rl 6342, Rl 6123, Rl 5432 Lhe.NC twcuty-four ar- 

rangements of the subscripts really jaeld only twelve different 
formulae, however, as each pair m which the first three figures 
arc the same and m the same order yield idc'iitical quantities 
in the formula. 

Coefficients of multiple correlation as well as those of partial 
correlation require so much work if many r anables are con- 
cerned that it 18 of considerable importance to organize and 
systematize the work in the most economical fashion. The 
reader who is planning to do much work of this sort., in which 
more than four variables are concerned, is advised to consult 
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some or all of the references i^iven below.* Of them, perhaps 
that by Griffin is most helpful 

There is some disapjeement among the wnters just referred 
to and others as to which of the methods is the best. When the 
number of the variables concerned is from about five to ten the 
Doolittle Method seems to the writer the best. When the 

*A E Brandt, “The Ihe of Machine Factoring m Multiple Correla- 
tion,” Journal of Die American Statistical Association, Vol. 23, Septcinlier, 

1928, pp 291-295. 

Mordecai Ezekiel. Methods of Correlation Analysis (New York, John Wiley 
* Sons, 1930), pp 357-.366 

Raymond F'ranzen and .Mahow Dcrryherry, “The Roiituie Computa- 
tion of Partial and MuUipk* Correlation,’ Journal of Educational Psy- 
chology, Vol 22, December, 19,11, jip tV41-(’>.')l 

Henry E Garrett, “A Modification of Tolley and Ezekiel’s Method of 
Handling Multiple Correlation Problems,” Journal of Educational Psy- 
chology, Vol 19, January, 192S, pi> I.")— 19 

Harold D Griffin, “Sinijilihed Sctienia,s for Multiple Linear Correla- 
tion,” Journal of Experimental Education, Vol. 1, March, 1933, [ip 239- 
264 

Truman L Kelley and Quinn MiN’einar, "Doolittle ver'iii.s the Kelley- 
Sahsbury Iteration Method foi Computing Multijilo Rcgreasion Coeffi- 
cients,” Journal of the .Immion Statistical Association, Vol 24, June, 

1929, pp 164-199 

Truman L Kelley and Fr.uik S .Salisbury, “An Iteration Method for 
Determmmg Multiple Corrcl.ition ('on'-tant.x,” Journal of the American 
Statistical Association, Vol 21, .Septiunlier, 1926. f)[) 282-2*12 

Charles C. Peters and Eli/abclh C Wykes, “Simplified Methods for 
Computing Regression Cwflioicnt' and Multiple and Partial Correlations,” 
Journal of Educational Researih, Vol 21, June, I'Ml, pp 44-.52 

Frank S Salisbury, “A Simplified Method of Computing Multiple Cor- 
relation Constants,” Journal of Educational Psychology, Vol 20, January, 
1929, pp 44-52 

Percival M Symonds, “ JoleAnalvsis Sheet for Computing Partial and 
Multiple Coefficients of Correlation and Regression Coefficients,” Teachers 
College Record, Vol 27, Seiiteralier, 19’25, pp 52 -69 

H R Tolley and M J B Ezekiel, “A Method of Handlmg Multiple 
Correlation Problems,” Journal of the American Statistical Association, 
Vol. 18, December, 1923, pp 99:5-1003 

, “The Doolittle Method for Solving Multijile Correlation Equa- 
tions versus the Kelley-Salisimiy ‘Iteration’ Method,” Journal of the 
American Statistical Association, Vol 22, December, 1927, pp. 497-600. 

R J Wherry, “A Modification of the Doolittle Method: A Loganthnuo 
Solution,” Journal of Educational Psychology, Vol 23, September, 1932, 
pp. 465-459. 

E R Wood, “A Graphic Method of Calculating Multiple Correla- 
tions ” (Emporia, Kansas, KanssH State Teachers College). Founfiagee. 
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number of variables is larger tlian this the Kelley-Salisbury 
Iteration Method appears preferable. The method of deter- 
minants may be applied to multiple coefficients as well as to 
partial coefficients and offers some advantages when there are 
not more than four or five variables to be dealt with. Discus- 
sions of this method will be found m Kelley, ^ Holzinger,® and 
Gregory and Renfrow.^ 

Tabic LVII IS presented to show the relationship between 
certain zero-order coefficients and multiple cm-fficients based 
upon them. It gives the multiple coefficients for one vanable 
with from t\^o 1o seven others for I'ach of a number of values 
of the zero-order coefficients upon which they are based The 
entries in this table may be computed by means of the usual 
formula for miiltiiile correlation already given, but it is easier 
to employ a special formula which applies in case all the zero- 
order coefficients ari' eiiual This fonnula is 



ill which n is the numbei of A.-iriables (oiieerned in the correla- 
tion The table shows that for zero-order coefficients of .90, for 
example, the multiple correlation of one variable w ith two others 
is 923, of one with three others .932, and so on up until that of 
one with seven others is 941. It will bi* seen that although 
then' are increases in tlu> c.ilues of multiple coefficients as more 
variables are addl'd, thev tend to be small and to decrease 
rather rapidly Also theie are no negative values of the multi- 
ple coefficients, but those baM'd upon negatne values of zero- 
order coefficients are po.silue, the same as those based upon 
positive values. This is accounted for by the form of the formula 
for multiple coefficients. 

* Trmimn L Kelley, SlaltMtral Sfellwd (New York, Macmillan Ck),, 
1923), pp 28S, 295-302. 

* Karl J Tlolzinger, Statuilual .\fcJluxU for SliuienlJt oi Eilucation (Boston, 
Ginn & Co., 1928), pp 312-31.'> 

* Chester Arthur Gregory and Omer W. Renfrew, Etatuitiad Method m 
Education and Psychdlo^ (C A Gregory Co , 1929), pp. 182-186. 
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TABLE LVII 

Relationship between Size of Zero-Order Coefficients of 
Correlation and of Multiple Coefficients Based Thereon 


Zero 

Order 

r’s 


Number of Variables 

Correlated with First 


2 

3 

'f 

5 

6 

7 

1 00 

* 



— 

— 

— 

— 

90 

923 

932 

93(> 

938 

940 

941 

.80 

843 

859 

868 

873 

876 

879 

70 

759 

1 783 

795 

803 

.808 

812 

60 

671 

701 

717 

728 

735 

740 

.50 

577 

612 

632 

645 

655 

661 

.40 

.478 

516 

.539 

555 

566 

574 

.30 

.372 

411 

435 

452 

465 

474 

.20 

258 

293 

316 

334 

346 

357 

.10 

135 

158 

175 

189 

200 

209 

.00 

.000 

000 

000 

000 

000 


- 10 

.149 

194 

239 

289 

346 

418 

-.20 

.316 

447 

632 

1 000 

— 

— 

- 30 

.507 

822 

— 

— 

— 

— 

-.40 

730 

— 

— 


— 

— 

- 50 

1 000 

— 

— 


— 

— 


• — indicates that tlie value o( the multiple coefficient of correletion corrcspobding to the 
■▼en seroorder coeffirieot le either indeterminate or that it is impossible to have the ID- 
loated aero>order coefficient between eutb pair of the indirated number of vanablea. 


For further methods of determining multiple relationship, 
includmg cases when a known qualitative factor is involved, 
the reader is referred to Ezekiel ‘ 

Interpretation. There are several limitations to the use and 
interpretation of coefficients of multiple correlation which 
should be noted. Probably the most important of these is that 
the formula assumes that the influence of the independent 
variables is additivQ only It is very hkely that m many cases 
this does not hold, and that one or more of the mdependent 
variables are multipliers of some of the others or that some 
more compheated relationship exists. However, no formula 
has been worked out for handling such a situation. A second 
limitation is that R cannot be negative If one or more of the 

• Mordecai Ezekiel, Methods of CorreUUton Arudysu (New Ywk, John 
Wiley & Sons, 1930), Chs. x, xi, xii, xiii, and xvii 
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zero-order coefficients from which it is derived are negative, 
its interpretation presents some difficulties. 

It should be noted that a multiple-correlation coefficient 
cannot be less than the greatest zero- or other order coefficient 
of the dependent with any of the mdependent vanables. More- 
over, the multiple correlation of a variable with two or three 
others w’lth which the zero-order correlations are fairly high, 
is rarely increasi'd much by adding other vanables. Indeed, 
if a zero-order coefficient is rather high it often increases it 
very slightly to bring in any other mdependent vanables. For 
example, if the ccH'fficient of correlation between age and height 
is .80, the coefficumt between age and weight 70, and that 
between height and weight .75, a multiple correlation of only 
.81 is obtained when R x nw is computed, thus showing the 
slight additional effect The increase depends upon the size of 
the zen>-order coefficients between the single vanable and 
those added and of those between the various ones denominated 
by the subscripts after the point. The larger the coefficients 
of the single vanable with the others, and the lower those 
among the others, the larger is the multiple coefficient Thus 
if, in the example just given, r//ir is reduced to 40, Ra-bw is 
increased to 90, if = .20, Ra hw = -98, and so on. In 
most practical situations the slightly increased accuracy of 
estimate gained by combining the effect of more than a few, 
perhaps three to five, vanables does not repay the labor in- 
volved. 

The interpretation of coefficients of multiple correlation, 
especially from the standpoint of how manj"^ factors having 
simple coefficients of correlation with the first vanable of given 
sizes are necessary to produce multiple coefficients of given 
sizes, has been well discussed by Hull * Dunlap and Cureton's 
article referred to under partial correlation likewise deals with 
the interpretation of multiple correlation ^ 

‘Clark L Hull, “The Joint Yield from Teams of Tests,” Joumed of 
Edveatutnal P»ycfu>lo(/y, Vol 14, October, 1923, pp 396-406 

, Aptitude Testing (Yonkers-on-Hudson, World Book Co., 1928), 

pp 257-264. 

’ Jack 'K Dunlap and Edward E Cureton, "On the Analysis of Causa- 
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Shrinkage. If the coefficient of multiple correlation derived 
from a given set of data is applied to another comparable set 
of data it does not exactly fit. This result is due to the effect of 
the variable errors present Since the regression equations 
derived in connection with multiple correlations are usually 
found so that they can be applied to other data, this discrepancy, 
or shrinkage, would be serious if it were very large. However, 
the shrinkage is so small that for most practical purpose's it 
may be neglected. Probably the best treatment of this 
point IS that of Larson " He gives a formula developed by 
B. B Smith “ which, with some change's in notation, is as fol- 


lows • R' 



1 - R‘ 

■ In this R' IS the estimated 

1 - - 
N 


correlation for the other data, R that actually obtained, n the 
number of variables, and N the' number eif cases. Thus, for 
example, if the obtained coe'fficie'nt of multiple correlation is 
.80, and there are five variable's and one hundred cases in- 
volved. 



which gives 788 or a dilTeTciice' of only 012 By actual com- 
putation and tryout in a numbe-r eif case's Larson found that 
the actual shrinkage te'iids to be somewhat less than the esti- 
mated shnnkage according to this feinnula The amount of 
tion,” Journal of Educational Psychology, Veil 21, De'cember, 1930, pp. 
657-680 

. * Selmer C Larson, “The Shrinkage of the Coeflicient of Multiple Cor- 
rriation," Journal of Educahoruil Psychology, Vol 22, .fanuary, 1931, 
pp 45-55. 

“Bradford B. Smith, “Forecasting the Acreage of Cotton,” Journal of 
the American Statutical Association, Vol 20, Maresh, 1925, pp. 31—47. 

“ A nomogram by which corrected values according to this formula may 
be obtaineil has l>een devised by Griffin See Harold D Gnffin, “Nomo- 
grams for Correcting Simple and Multiple Correlation Coefficients,” 
Journal of the American Slaltslical Assoctalton, Vol 25, September, 1930, 
316-319 
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shrinkage tends to increase with the number of variables and 
to decrease with increases in the size of the multiple coeflScient. 
For not more than ten variables, fairly large numbers of cases, 
and multiple coefficients of a sufficient size to be of much value 
in prediction, the shrinkage is rarely much greater than .01. 

Corrections for number of observations. The coefficient of 
multiple correlation obtained from a sample tends to be larger 
than the correct C(K‘ffieieTit for the total population from which 
the sample was taken This is espi'ciallv true if the number of 
cases IK small or tlie nurubi'r of variables m\olved large The 
formula by which such a coefficient may be corrected is as 
follows. 

R.„ 

To illustrate the application of this fonniila the first coefficient 
found on page ‘2Sfi may be lunployi'd In this case n, the num- 
ber of variables, eriuals 4 and since N is not given, we may 
assume it to be .50 Substituting in the fonnula, the corrected 
value of N/> follows 



which gives 732, thus vhowing a decrease of approximately .02. 
A fuller discussion of thi"' correction is given by Ezekiel. 

Curvilinear multiple correlation. If cur\ilinear relationship 
is known or KUs[iecte<l to exist, the ratio of niultiple correlation 
or the index of riiulti]ile coirelatiun max’ be emplo 3 'ed How- 
ever, then usi' ns not at all coiiiiuon in connection with educa- 
tional work. The formula for the ratio is 



in which is the standard ileviation of the mean values of 
the first variable for each cell, that is, for each group of meas- 

Mordceai Ezekiel, Melhwls of Cirrrdaiion Analysts (New York, John 
Wiley & Sons, 1930), pp. 176-178 
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ures falling in the same class according to the grouping of all 
the variables concerned. The a\ in the denominator is merely 
the standard deviation of the values of the first variable. The 
error involved in this formula is large, and unless there are on 
the average several cases in each cell, the obtained value is 
usually too large. 

The formula for the index of multiple correlation is 



In this X" refers to values of A' estimat.ed from the other 
variables concerned by methods of curvilinear regression and 
Z" = X — X” . Just as with the coeHicient of multiple cor- 
relation, so with the mdex, adjustment should be made for 
small numbers of cases 

Fuller discussions of curv'ilinear multiple correlation includ- 
ing the ratio, the index, and other methods, may be found in 
the references given below 

Partial multiple correlation. A modification of the formula 
for multiple correlation to take care of the rather rare situation 
in which one desires to find the multiple correlation between 
one variable and the sum of two or more others, with one or 
more still other variables held constant, has been offered by 

H. L Bean, “A Simplified Method of Graphic Cumlinear Correla- 
tion,” Journal of the American Statistical Association, Vol 24, December, 
1929, pp. 386-397 

, “Application of a Simplified Method of Correlation to Prob- 
lems in Acreage and Yield Variations,” Journal of the American Statistical 
Association, Vol 25, Decemlier, 1930, pp 428-439 

Mordecai Ezekiel, “A Method of Handling Curvilinear Correlation for 
any Number of Vanables," Journal of the American Statistical Assoeiatton, 
Vot,.19, December, 1924, pp 431-453. 

, Methods of Correlatum Analysis iNew York, John Wiley & Sons, 

1080), pp 187, 219, 224-227, 235-241, 262-264, 306-317 

H. L. Rietz and others. Handbook of Mathematical Statistics (Boston, 
Houghton MifBin Co., 1924), pp 146-149. 

H. R. Tolley and M J B Ezekiel, “A Method of Handling Multiple- 
Coirelstion Problems,” Journal of the American Statistical AssodaUon, 
Vol. 18, December, 1923, pp 993-1003 
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Stouffer.'* The formula for this purpose is 

■V^l — (1 — Uj • + 1. • + 2, . . . n)(l 23 . . . * — 1, • + 1. . • • »)• 

in which the subscripts after the last point denote the variables 
held constant. For only four vanables, that is, the correlation 
of 1 with 2 and 3 combined when 4 is held constant, the formula 
becomes 


Rl 23 i — \/l — (1 ~ u's 2»)- 

Dunlap and Cureton also deal with the same type of correla- 
tion. 

Exercises 

1. Compute all coefficients of multiple correlation for each of the 
sets of eero-order coefficients given in Exercise 1 at the end of the last 
chapter 

2 Correct for shrinkage in each of the following cases A. R = 90, 

= 200, n = 14, H R = 65, iV = 160, n = 4. 

3. Correct for number of observations in each of the cases given in 
Exercise 2. 

*’ Samuel A. StoufTer, ‘‘.A Coefficient of ‘Combined Partial Correlation’ 
with an Example from Sociological Data,” Journal of the American Star 
luttcal Associatuin, V'ol 29, March, 1934, pp 70-71 

“ Jack W Dunlap and Eklward E Cureton, “On the Analysis of Causa- 
tion,” Port VII, Journal of EducatumcU Feychoiogy, VoL 21, December, 
1930, pp 676-678. 



CHAPTER XVII 

PARTIAL AND MULTIPLE REGRESSION 

Introduction. Just as ordinary rpsrression coefficients and 
equations have a close connection uith zenvorder coefficients 
of correlation, so do the coefheieiits and ('qiiatioiis of partial or 
multiple regression have a similar iiJatioiiship to the cix-fficients 
of partial and multipk^ correlation Partial- or multiple-regres- 
sion equations provide the best means of estimating one van- 
able when the values of two or moie otlu'rs with which it has 
been correlated are known d'liev differ, therefore, from ordi- 
nary regression equations in coiilainmg more tenns, one for 
each of the variables correlated with the one to be estimated. 
Their use and the mterpret.uion of results therefrom are the 
same. 

Although the corresponding coefficients of correlation differ, 
the partial- and multiple-regiession coefficients and equations 
are the same For any given situation in which one variable 
has been correlated with several others, and in which both its 
partial and multiple correlation^ haw beim found, there is but 
one best set of regression coefheieiits and a single be.st regres- 
sion equation for estimating ii m tenns of thi' othi r lariables 
involved Thi'se may be called either partial or multiple ac- 
cording to the point of vuw Liken If each coefhcieiit or each 
term in the equation except the constant lenn is thought of 
separately as makmg an individual contiibution apart from 
the others to the e,stmiation of the single variable, the term 
partial IS appropnlfte If the tenns are thought of in combma- 
laon rather than separately, the tenn multiple i« a])propriate. 

The term net regression is also soinetinies used as svTioiiymous 
with partial regression The net.-regression coefficient is the 
coefficient of one term in the multiple-regression equation n n j 
thus shows the change m one vanablc corresponding to the 

296 
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unit change in another when the effect of others is eliminated 
or held constant. 

Partial standard deviations. Since the two formula by which 
coefficients and equations of partial or multiple regression are 
most commonly computed involve the partial standard devia- 
tions, these fonnula; will be explained first They are the stand- 
ard deviations of the variables concerned when the values of 
others included in partial correlation with them are held con- 
stant. The most convenient form of the general formula for a 
partial standard di-viation is probably 

<r 1.234 . . n = 

rjl 23 V^l 23 . . (n — l), OF 

<riV(l - rfj)!! - rf, ,)(1 - Tif, 23) . .(l-rf„ 23 .. (. - ii ' 

Another form somet imes employed is 

<ri 2,14 . n = O’) 234 . , („ - l)V"l ~ 'iB-2J4 ... in - 1) 

It Will be noted that both formulae require the partial coefficient 
of correlation of the next lower order than the partial standard 
deviation. In addition to this, the first calls for one coefficient 
of correlation of each lower order and the second for the par- 
tial standard dexiation of the next lower order. If the coeffi- 
cient of multiple correlation has already been computed, it is 
convenient to employ the fonnula, 

O'! 234 . n = <rj\/l — 234 . » 

Since, however, the multiple coefficient is not necessary to the 
computation of the part lal standard deviations and the multipie- 
regression coefficients and equations, it is sometimes not found, 
and 80 18 not available. 

When only two variables are concerned the partial standard, 
deviation formula becomes <ri.2 = <rvs/\ - rf 2 > and for three 

' The formula' for partial standard deviations may also be wntten chiefly 
in terms of coefficients of alienation Thus the one f^ven aliove becomes 
ffvfcu fci, 1 1.,4 It . ki^n. . (B-ii, and the others given m this chapter 
may be smularly changed. 
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it is: * 

<ri.it = (Ti-is/l - fit-i, or<ri.s-\/l - rf,.,. 

If the value of the first-order partial standard deviation given 
above is substituted in the formula for the second-order one, 
the result is the same as from the first formula given : 

= <ri\/(i - rfj)(l - 4 - 2 ), or = - rj 3 )(l - rj,.,). 

The corresponding formulae for the other two partial standard 
deviations of the second order are: 

<rt.u = - r?j)(l - rfa i), or = < 70^(1 - 7|,)(1 - 

and 

tri.ii = a3\/(l - r^ 3 )(l - Tm i), or = ffaVCl - rtj)(l - rj,.,). 

The form in which these are given is usually the most convenient 
to use for second-order partial standard deviations. 

The data previously used in the discussion of partial and 
multiple correlation may be used to illustrate that of the par- 
tial standard deviations. It will be recalled that r//p = .50, 
rgs = .65, rpK - .60, rpp p = 181, rgp.p = .505 and rpp g = 
.418. The standard deviations are also needed, so <rg will be 
taken as 8, <rp as 6 and ap as 10 From these the partial stand- 
ard deviations are found as follows: 

irg.pR = 8\/{l - 50’)(1 - .505*) or 

8\/(l - .65*)(1 - .18P) = 5.98, 

(Tp.RH = 6V'(1 - 60^){1 - .181*) or 

6\/(l - .50»)(1 - .418’') = 4 72, and 

<rR.BP = 10-v/(l - 65*)(1 - .418*) or 

10 Va - .60*) (1 - .505*) = 6.90 
*Thie partial standard deviations, sinjilar to the partial correlation 
eoefficients, may be found in an ever-increoMiig numlier of ways as 
timr order increases By tidung advantage of this fact it is readily shown 

that — - — • “ —I and so on, the general case being that 

«fl vj Vl.u Vj , 

Pt-U* • . . « g| a« . . « 

**•1*4... » Vl.|4...fl 
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The same reaults may be secured by the formula involving 
multiple correlation. Since Rh-pr = -SM, Rp.br = -617, and 
Rr-hp = -723, this formula gives ob-pr = 8\/l — .664* = 5.98, 
<rp.BR = 6V1 - .617* = 4.72, and ap.pB = lOVl - .723* = 
6.91. 

Computation of the regression coefficients. The general 

formula for a coefficient of partial or multiple regression is 
commonly given in some one of three forms. These are as fol- 
lows; 

bii.u . . . n 

f . fn - ll “ Tin J4 (n - |4 . . (n - l) »4 . . (» - l) 

B — - iir-- - ■ - — - ~ Off 

A r in 34 . . (n - l) »4 . . . U - l) 


(n - i) “• bln 84 fn - 1) fen 


(n- !) 


1 bin 14 (n— I) bnt 14 (n- i) 


The first of these involves both the partial coefficients and 
standard deviations of the ne.\t lower order than the desired 
regression coefficient , the second requires the partial coefficients 
and standard dex iations of the same order as the desired regres- 
sion coefficient, and the third makes use of the regression co- 
efficients of the next lower order. In actual practice the first 
two arc more frequently used than the third, since the partial- 
regression coefficients of lower orders are not commonly found 
unless they are w’anti'd on their own account 
For three vanables th(> formulae given aboie become: 


612.3 


ri2 ~ ru r;3 
1 — ^ 


Cl Cl. 3 

— or rii j or 

C« (7j 3 


6it ~ bit'bn 
1 — 633 bu 


By substitutmg for the partial standard deviations m the seotmd 
of the three formulae we obtain 


612-* 


fit.y 


C2vT^- 


This 18 probably the most common method of securing a partial- 
r^ression coefficient when three variables are concerned. The 
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other five of the six possible regression coefficients for three 
variables may be obtained from the following similar formults: 

- r».r-y 

r . A - fis 

b«., - 3^7^ 

63.-5 - r,. 5 -|/ 3—3^ 

63a 1 = r 32 1 ~i/l X 

02 V 1 - rf j 

To illustrate the use of thes(‘ fonnul® the partial-regression 
coefficients for the data dealing with history, physiology, and 
reading scores will be used From the measures already com- 
puted the partial-regression coefficients may be found as follows, 
oung the last formula in the preceding paragraph: 

igpR = = -229 

6H«..= .505^yi^: = .437 
bPBR = ■^^4y^r^2 =-143 
bpB.H = -418^1/^^' = .286 
= .505^/1/353^1 = .583 

bBPB = •4i8^/|/f5:^ = -eii- 

^ the first-order partial standard deviations arodt^stred, they 
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may be obtained from the numerators or denominators of the 
factions in the formuhe just used. Thus: 

ob-p = 8v^l — .50^ = 6.93, ob-r — S's/l — .65® = 6.08, 

ap.B = 6V1 - .50’ = 5.20, ap.R = 6\/l - .60* = 4.80, 

VR-B = lOVl - .65^ = 7.60, OR.p = lOVl - .60* = 8.00. 

Forming regression eqiutions. The coefficients of partial 
regression are employed m just the same way to obtain the 
partial- or multiple-regression equations as are zero-order re- 
gression coefficients to secure zero-order or ordinary regression 
equations. Thus if we use X i to refer to the dependent variable, 
that is, the one that is being estimated m terms of the others, 
and Xt, Xi, and so on, to refer to the independent variables or 
the ones in terms of which is being estimated, the equation 
may be written as follows in terms of deviations: 

Xi — 6iJ.« . n rj +■ hl3 24 . . . n'Xi hu.JS . . . (i* - l)’**. 

In terms of measures, this becomes 

= blt.H . , n (•‘^1 ~ l) + h«.2« . . . n'{Xt — . 

■h bin 23 ...(»- 1) {Xn — -f- Afj. 

For the three variables and the data derived therefrom already 
used in the preceding paragraph the regression equations in 
terms of deviations may then be written as follows . h = .229p -h 
.437r, p = .143^ -f- .286r, and r = .5S3h 4- .611p. If measures 
are used these become 

H = .229(P - Mp) -h .437(ft - Mr) -f Mb, 

P = ,143(// - Mb) + .286(« - Mr) -f Mp, and 
R = .586(i7 - Mb) + .611(F - Mp) 4- Mr. 

If for the means of the three variables the following values are 
assumed: Mb = 80, Mp ^ 85, and Mg = 40; the last equatuma 
beotnne: 

H « .229(F - 85) + .437(fi - 40) -f 80, 

P * .143(ff - 80) -f- .286(fi - 40) -|- 85, and 
R « .586(ff - 80) -f .611(P - 85) -f- 40. 
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■njese reduce to 

H = .229P + .437ff + 43.06, 

P = .143// + .286P + 62.12, and 
R = .586// + .eilP - 58.82. 


The interpretation of these is similar to that of ordinary 
regression equations. The third, for example, means that ac- 
cording to the data u.sed a pupil’s most likely score on the 
reading test is equal to .586 times his history mark -f .611 times 
his physiology mark — 58 82. Thus the most likely reading-test 
score of a pupil whose history mark is 90, and whose physiology 
mark is 70, is 37.’ 

If four variables are concerned the formula for the partial- 
regression coefficient usually the most convenient is 


bit 


34 — ri2 34 


i / ~ ~ ^4 3) 

r (1 ~ ^l))(l ~ ^ 3) 


For all four multiple-regression equations twelve such coefficients 
are necessary, three for each. All will not be given here, but 
merely the other two needed for the equation of variable 1 m 
terms of the others. They are 



(1 ^ 4 l) 

(1 ~ j) 


(1 - rft)(l - rjs i)__ 
(1 I'DCi ~ 134 2) 


and 


For the purpose of checking, each of these three may be written 
otherwise as shown above 

To illustrate the us^ of the formulae just given the data already 
employed may be used again. To do so the mean and standard 
deviation of the inteUigence test scores must be known. These 
may be taken as 105 and 20. If it is desired to estimate phye- 


* For ordinary work it la suiRcieaffb use regression coefficients accurate 
to the second decinoal place only. For careful Work, especially in cases m 
wfaieh the original data are reliable and accurate enough to justify so 
doing, three or. four places should be used. In this case most of the dUfer- 
ences would ni^ exc^ one- or two-tentbs. 
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iology scores when the other three are known, the coefficients 
are given by 


I _ _ <^P . /(I - rfp)(l - 

b,n.,n - W - r!,,,)’ 

-i/ ~ 

OlV (1 — “ ^Hu) 


bpi HR = rpi 


bpR HI = rpR HI 


Or 


" i / ~ ^^Hp)^^ ~ Ap-h) . 
'if (1 “ ^sHi — Ar-h) 


Substituting in thesi' gives 


bpH IR = 


bpi HR = 


bpR HI = 


-.055 


544 

.011 



- 75^) (1 - 

- 0002) 


sy (1 - 

- .702)(1 - 

- 2102) - 


6 ./a 

- .502) (1 

- 4182) 


2oy (1 

- .702)(1 

- .6302) “ 

cUili 


- 50*) (1 

- 6472) 

noQ 

loy (1 

- .652)(1 

- .6302) 



From these 


P = - 039(// - 80) + 233(7 - 105) + .009(/e - 40) + 85. 
whence 

P = - 0397/ + 2337 + .009P + 63 30. 

As appears from inspection of the example just given, it is not 
necessary to know all of the lower-order coefficients of partial 
correlation in order to compute the partial standard deviations 
and regression coefficients In workmg a problem such as that 
just given, one should begin as illustrated, by writing out the 
formulae for the desired coefficients, and then compute only 
those of a lower order needl'd to secure the hf^er-order ones. 

The computation of partial-regregsion equations without ' 
making direct use of partial correlation has been treated by ft 
number of writers. Workers ’iriho eftpect to make consider^de 
use of partial regression involving toore than four variaiiies 
should become familiar with the method suggested by Doolittiie.* 

^ M. H. Doolittle, "Method Employed in the Solution Ijf/Nomial Equs- 
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This has been explained and modified by a number of others, 
especially by Tolley and Ezekiel ‘ and by Wallace and Snedecor,* 
The matter has been well summarized by Griffin,’ who includes 
with his discussion a rather complete bibliography dealing with 
partial regression. Probably the most convenient methods, 
however, are those suggested by Peters and Wykes,® who present 
one method for use in case there are no more than five variables 
and another, which is a variation of the Doolittle method, as 
best for more than five.® 

Wood “ has suggested a graphic method by which partial- 
regression coeflScients may be obtained Apparently it is possible 
by its use to compute such coefficients in less than half the time 
required by ordinary methods Errors are involved but they are 
rarely large enough to be senous Therefore, anyone who has 
many such coefficients to compute may well become familiar 
with Wood’s method. Gnffin “ has prepared a set of pre- 
diction charts or nomograms that may be found helpful 

tions and the Adjustment of a Tnangulation,” Coa»t and Geodetic Stmev 
Report, 1879, pp 115-120 

‘ H. R. Tolley and M M. B Ezekiel, “A Method of Handling Multiple 
Correlation Problems,” Journal of the American Statistical Assodotioti, 
Vol. 28, December, 1923, pp. 993-1003 

•H A. Wallace and George W Snedecor, “Correlation and Machine 
Caleulation,” Iowa State College of Agriculture and Mechanic Arts Official 
PiMieatvm, Vol. 23, January 28, 1925, pp. 22-30. 

’Harold D GnflSn, “On Partial Correlation vs. Partial Regression for 
Obtaining the Multiple-Regression Elquations,” Journal of Educational 
Psychology, Vol 22, January, 1931, pp 35-44 

• Charles C. Peters and Elizafieth Crossley Wykes, “Simplified Methods 
for Computing Regression Coefficients and Multiple and Partial Correla- 
tions,” Journal of Educational fCesearch, Vol. 23, May, 1631, pp. 383-393; 
Vol. 24, June, 1931, pp 44-.52 

• In addition to the references given above most of the references given 
In Note 1 of the preceding cliapter should be consulted by the reader who 
wishes to make a thorough study of methods of computing multiple-regros- 
■ion coeflScients. 

“ Ernest Richard Wood, “A Graphic Method of Obtatmng the Partial- 
Correlation Coefficients and the Partial-Regpwsion Coefficients of Thres 
or More Variables,” Supplementary Educalumal Monographs, No. 37 
(Chicago, University of Chicago, Ja&Miy, 1931), 72 pp 

’’Harold D Griffin, “ConstruoUng a Prediction Chart (Charting 
LiiWBr-Regression Equations),” Journal of Applied PsycheAogy, Vol. IS, 
August, 1932, pp. 40^12. 
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when one variable is to be predicted or estimated from three 
others. 

The j3 coefficients mentioned on page 245 in connection with 
ordinary regression may also be obtained and are sometimes 
more useful than the b coefficients m the case of partial or 
multiple regression. The general formula for them is merely 

. . . n = his M . . . »— • Their chief value m this coimection 
<r I 

lies in the fact that they offer information, although not entirely 
unambiguous information, as to the relative importance or size 
of contributions by the several variables used in predictmg the 
dependent variable. In coimection with these coefficients it 
should be mentioned that /3 coefficients m the standard score 
form of the regression equation are equivalent to path co- 
efficients. 

Weighting independent variables widiout computing re- 
gression equations. In many cases in which multiple-regression 
equations might bo employed to estimate the values of a va- 
riable, only senes of numbers that indicate the best estunates of 
the proportional magnitudes of the values of the independent 
variables are desired It is often not important to find out how 
much ability will probably be exhibited by each individual, 
but rather to determine the proportional relationships between 
the degrees of ability An example of such a case might be the 
placing of pupils m so-called homogeneous groups for purposes 
of instruction. If, let us say, there are to be four such groups, 
one of which contains the upper one-fourth of the class, the next 
the second one-fourth, and so on, it is immaterial whether or not 
the probable achievements of the pupils are determined abso- 
lutely. They must, however, be known relatively. In such 
situations where only three variables are involved it is possible 
to determme such numbers by a formula that requires less woric 
than that for multiple coefficients. If the subscript 1 is u?ed to 
represent the dependent variable, an<j,;S and S those in tenns 
which it is to be estimated, tli^farmula is 

^ <7i ri» — rij-r** 

W 

<r» ri* — Tij-rM 
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In this IF denotes the weight by which an individual’s score in 
variable 3 should be multiplied before adding it to his score on 
variable 2 to get the best prediction of the desired variable 1. 

It wiU be seen that the economy m the use of this formula 
results from the fact that only one instead of two weights must 
be computed since that of one of the two dependent vanables is 
taken as unity. The application of this formula may be illus- 
trated by the data already used Assummg that we wish to 
estimate history m terms of physiology and rcadmg, the formula 
becomes 


6 65 - 50 X .60 

10 ^ .50 - .65 X .60 


1.91 


Therefore the desired equation rs H = P + 1 911?. If this is 
compared with the corresponding regression equation already 
obtained, which \a H = 229P + 437/? + 43 06, it will be seen 
tiuit the ratio between the coelhcients of P and R, .229 and 437, 
respectively, is the same as the multiplier of R given above, 1.91. 

The reader who is interested in a somewhat fuller discussion 
connected with this last method of weighting is referred to 
Otis** and Hull.'® Certain other short-cut methods which may 
sometimes be employed in connection with multiple regression 
are given by Ezekiel.'^ 

Wyghting according to reliability. Although the ordinary 
method of weightmg vanables concerned m the estimation of 
another variable is that already desenbed, that is, either by the 
partial-regression coefficients or by the formula given in the 
last paragraph, it sometunes happens that another basis of 
weighting should be employed Kelley has shown that if the 
two or more independent vanables are senes of measures of the 

“Arthur S. Otia SbUislical Method in Edwalumal Measurement (Yon- 
kera-on-Hudson, Wbrfd Book Co , 192.5), pp. 240-241 
* •* Clark L. HuU, Aptitude Testing (Yorjcer»-on-HudKoii, World Book Co., 
1928), pp. 445^57^SiM “ Prediction Formul® for Teams of Aptitude Teste," 
Jounud of ApTplied Psychology, Vol 7, Septemlier, 1923, pp. 277-284. 

“Mordecai Ezeldd, ‘‘Short-Cut Methods of Determining Net Regres- 
sion Lines and Curves," Methods of Coirdatvon Analysts (New York, John 
VnOey & Sons, 1930), Ch. xvi 

» Tniitian Lee Kelley, Interpretation of Educaltonal Measuremmts 
(YOTtkers-on-Hudson, World Book Co., 1927), pp 211-213. 
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same thing, their respective weights should be determined by 
Vr 

the values of , in which r is the coefficient of reliability. 

1 — r 


For example, if intelligence has been measured by three tests 
which are so similar that they may be considered as measuring 
the same thmg, and if the respective coefficients of reliahility 
of these three tests are .90, .80, and .70, the relative weights to 
be given the three m combining them to secure a single estuuate 
or measure of intelligence are as follows, respectively: 


VOO 
1 - 90 


9.49, 


\/.80 
1 - 80 


= 4 47, and 


V.70 
1 - .70 


2.79. 


In other words, a pupil’s score on the first test should be mul- 
tiplied by 9 49, his score on the second by 4.47, and on the third 
by 2 79. The same relative results can be obtained by changing 
the weights to such a basis that the smallest one is made unity 
and the others proportional thereto In this instance this result 
is obtained by dividing by 2 79, which gives weights of 3.40, 

1 60, and 1 00, respectively Before employing this method, one 
must express the various test scores m standard or equivaleflt 
units. 

Curvilinear and other additional multiple-regression metfiods. 

It IS possible to compute multiple regressions in the case of 
variables between which the relationships are curv ilinear rather 
than rectdineai*. The methods of doing so aie m general rather 
difficult, however, and are so rarely employed m educational . 
work that they will not Ix’ given here. They may be found m the ' 
same references given in the discussion of curvilmear multiple 
correlation m the last chapter Moreover, it is also possible to 
compute the relationship between one variable and two or 
more others acting jointly rather than ifaijependently as is 
assumed in the case of the ordinary multiple-regression equation. 
A discussion of this is given m Chapter 20 of EiBekiel. 

** Mordecai Ezekiel, Mtihodi of Correlaiion Analyms (New Yxjrk, John 
Wiley & Sons, 1930), Ch. xx, “Measuring the Relation between One Vana- 
ble and Two or More Others Operating Jointly.” 
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ExxRaszs 

1. Find the multiple-ref^eesion equations for estimating each vari- 

able from the other two for the following data; Mi » 35, Mj » 8, 
M» “ 14.4; ffi = 4.2, <rj = 1.5, =* 2.7; ru = .64, ri* = .56, 

rj, = .45. 

2. Find the multiple-regression equation for estimating variable A 
ftom B, C, and D for the foUowmgdata = 125, Mb = 80, Me = 
3.5, Md — 42.5; (Ta = 17.5, cb = 10, vc = 1.2, ffo = 7.2, tab = 78, 
tac = -60, tad = -32, tbc = 72, tbd = 50, rco = .45. 

3. Find the multiple-regression equations for estimating each vari- 
able from the other two for the data given in Exercise 2 at the end of 
Chapter XV on page 281 . 

4. From the data in Exercise 1 find the proportional weights for each 
of the following conditions 

A. For estimating variable / if ^ is taken as unity 

B. For estimating vanable f if d is taken as unity. 

C. For estimating vanable 3 if 1 is taken as unity 

5. Find the proper weights according to reliability for the first two 
of three series of data whose coefficients of reliabihty are .93, .88, and 
.82, if the weight for the last is taken as 1. 



CHAPTER XVIII 
THE CORRELATION OF ATTRIBUTES 

Introduction. Although the worker m educational statistics 
is usually concerned with variables, occasions arise when he 
desires to compute the relationship between two or more series 
of attributes '■ or between one senes of attributes and another 
of vanables. In general the correlation of attnbutes is simpler 
and mvolves leas computation than does that of vanables, but 
the resulting measures of relationship are not generally so exact 
as those derived from vanables. 

Some of the methods used in correlating attributes are based 
upon a twofold or dichotomous grouping of each characteristic 
or trait, whereas others may be employed with any number of 
groups. Several of the former methods will first be presented. 
Since each charactenstic is dmded mto two groups the result- 
ing table contams four compartments and is therefore known 
as a fourfold table In practically all the methods of computing 
relationship among data m a fourfold table use is made of the 
symbols a, b, c, and d to represent the number of measures fall- 
ing in each of the four compartments of the table as shown hy 
the accompanymg diagram. The sym- 
bol a represents the number of meas- 
ures that are high or above the mean 
m both traits; d, the number of meas- 
ures below the mean m both; b, the 
number above in one and below in the 
other; and c, the same except that the two are reversed. The 
lines of division should be the mean values of the traits and 
unless this condition holds the formuhe for fourfold tables ate 
not stnctly vahd. However, it is common to employ them in 

* The method of attributes involves the grouping of individuahi aooord- 
ing to the presence or absence of a given trait or the presenoe of one or 
another of several traits. In general these traits are not numaiicaDy meas- 
ured. 


a 

-1- + 

b 

+ - 

1 

+ 

1 

1 
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other cases and if the dividing points are not too different from 
the means the results are valid enough for rough work. 

Any two series of variables can be, but rarely are, thrown 
into a form suitable for tabulation m the manner just described. 
For example, if marks have been recorded in per cents all that 
it is necessary to do is to determme the mean per cent of each 
series and then tabulate them in the four cells of the table. 

It sometimes occurs that the data being dealt with are such 
that one class cannot be considered as higher than another. 
For example, the two divisions of the table one way may be 
boys and girls, the other way light complexion and dark com- 
plexion. The coefficient obtained m such a case should be in- 
terpreted m the hght of the way the table has been constructed. 
If the first column represents boys, the second girls, the upper 
row light complexion and th(> lower row dark complexion, so 
that a is the number of boys w’lth hght complexions, d the 
number of guls wnth dark complexions, and so on, a positive 
coefficient shows that boys tend to have light complexions and 
^prls dark complexions 

' The product-moment coefficient of correlation of a fourfold 

tabic. If, as is not usually the case, however, the two classes of 
each charactenstic concerned m a fourfold table are numencal, 
it is possible, although not general practice, to find the product- 
moment coefficient of correlation therefor by the regular method. 
It has been suggested that it is possible to secure an approxima- 
tion to this coefficient by the use of the following formula: 

^ ej(6 -I- d){a -)- b)(c + d) 

The application of this formula may be illustrakHi by a group 
■of forty pupils who are classified according to whether they 
are above or below the mean m Enghsh and algebra. If there 
are twelve above the mean m both subjects, seven above in 
finglish but below in algebra, eight above m algebra but not 
in Engludi, and thirteen below in both, the formula gives, as 
dhotm in Table LIX, r = .20. 
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TABLE LVIII 

ApPHOXIMATION to PuODDCT-MoBilNT COEFFI- 
CIENT OF Correlation for a Focrfold 
Table 


r 


English 

1 Algebra 

Total 

1- 

j A fpove 

Below 

Aixive 

12 

' ■ 

: 10 

[ 

Below 

8 1 

i 13 1 

, 1 

! 21 

I- 

Total 

! 20 1 

i 20 

'> 10 


v''(l'm<7T7“+’l3) (12 (8 + 13) 


If it IS assumed that positions above and below the mean con- 
stitute two numerical classes and the regular product-moment 
coefBcient of correlation computed, it is found to be 25 The 
difference betwt'cn this and .20 is small enough to indicate that 
the formula employed in Table L\TII doi's, m this case, yield 
♦ an approximation to r. In general, the formula does so ntuch 
more closely if a is smaller than 6 -|- d, if a + c = 5 + d, or if 
o + 6 = c + d. Otherwise the approximation is likely to be 
quite poor. 

Tetrachoric correlation. Probably the best measure of tJie 
relationship in a fourfold (able is the tetrachonc coefficient of 
correlation Its use ;ls.suitu's that the two distnbutions con- 
cerned conform to the nonnal frequency cur\'e. The direct 
computation of this coeihcient involves the solution of higher 
degree equations, so will not be given here The reader who 
desires to employ it should consult the followmg references,* 

• Leone Chesire, Milton Stiffir, and L L. Thurstone, Computing Dia- 
grams for the Telrarhorvc-Corretatum CoeffinerU (Clncago, University of 
Chicago Bookstore, 1933). 

Truman L. Kelley, SlaltsUcal Method (New York, Macmillan Oo., 19231, 
pp. 253-258. 

H. L. Rietz and others. Handbook of AfathematuxU Statutics (BcatoD- 
Rpuplbton MifBin Co., 1921), pp 133-135. * 
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the first of which contains diagrams that facilitate the work aiui 
obviate the necessity of solving the equations referred to. 

Yule’s coefficients. Yule has suggested two coefficients to 
be used in measuring the relationship in fourfold tables. The 
first of these, called Yule’s coefficient of association and abbre- 

ad ~ \)c 

viated by Q, is given by the formula Q = ^ The second, 


called Yule’s coefficient of colligation and abbreviated by ta 
{omega), is the same except that there is a radical over each of 

the four quantities. Thus w = The calculation 

Vad + Vbc 

of these coefficients is shown by the following example, which 
uses the same data employed earher m this chapter. It will 
be recalled that a = 12, 6 = 7, c = 8, and d = 13 Substitut- 
ing in the formulae just given, 


_ 12 13 - 7 8 
^ 12-13 -h 7-8 


47, and w = 


Vl2 13 - 
Vl2j3 + \/f8 


Both of these coefficients vaiy m value from -1-1.00 through 
0 to — 1.00. They are not at all equivalent, however, to product- 
moment r. Neither one has received much use. Yule apparently 
(xmsiders u a better measure than Q, but senous objections 
have been oflfered to the use of either. Fuller discussions may 
be found in Yule * and Kelley * 

Pearson’s cosine ir method. Pearson has suggested a method 
usually known as the cosine tt (pt) method which is preferable 
to either of those suggested by Yule. The value yielded by its 
use is approximately equivalent to product-moment r. The 
formula * is 

y/bc 

r = cos — = 7='^- 

Vod + y/bc 


* O. Udny Yule, An IrUroductum to ike Theory of Slatisttct, ninth edi- 
fiffi, nvised (London, Charles Griffin & Co , 1929), pp 37-39. 

* Truman L. Kdley, op. cit., pp. 260-262. 

* T is used m this formula as is common in trigoDometric and other 
computations dealing with the circle, as equal to 180°. 
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For the data already used this formula yields 


r = cos- 


V7-8 


zTT = cos67° 27' = .38. 


Securing the value of r by the method just illustrated involves 
the use of trigonometric tables giving the value of the cosine. 
It is simpler however to employ a table, which has the effect 
of eliminatmg the cosme from consideration by giving directly 
the value of r corresponding to a given value of the fraction in 


TABLE LIX 


Values of r Corhesponding to CIektain Values of the Fraction 
\^l 


VoS + VBc 


Used in Pearson’s Cosine tt Method • 


VBc 

f 

VSc 

■ 


■ 

•\/Bc 

r 

y/aB + %/Sf 

\/ail + VSc 



500 

00 

416 

26 

330 

51 

225 

.76 

.497 

01 

413 

27 

326 

52 

.220 

.77 

.494 

02 

410 

28 

322 

.53 


.78 

.490 

03 

406 

29 

318 

.54 

KB 

.79 

.487 

04 

403 

.30 

.315 

55 

.205 


.484 

05 

400 

31 

311 

56 

.199 ! 

.81 

.481 

06 

396 

32 

307 

57 

.194 


.478 

07 

393 

33 

.303 

58 

.188 

.83 

.475 

.08 

390 

34 

299 

59 

.183 

.84 

.471 

09 

386 

35 

295 

60 

.177 

.85 

.468 

10 

383 

36 

291 

61 

.170 

J86 

.465 

11 

379 

37 

287 

62 

.164 

.87 

.462 

12 ' 

376 

38 

283 

63 

.158 

.88 

.458 

13 

373 

39 

279 

.64 

.151 

.89 

.455 

14 

369 

40 

275 

65 

.144 


.452 

.15 

.366 

41 

.271 

66 

.136 

.91 

.449 

16 

362 

42 

266 

67 

.128 

.92 

.446 

17 

359 

43 

262 

68 

.120 

.93 

442 

18 

.355 

44 j 

258 

69 

.111 

.94 

.439 

.19 

351 

45 i 

253 

70 

.101 

.95 

.436 

20 

.348 

46 

249 

71 


.96 

.433 

21 

344 

47 

.244 


.078 1 

.97 

.429 

.22 

.341 

481 

.240 

73 1 

.064 

.98 

.426 

23 

.337 

49 

235 

74 

.045 

.99 

.423 

24 

.333 

.50 

.230 

.75 


KE3 

.420 

.26 





1 

1 


* Thia table may alao ba uaed tu daurmina tba yalua of r comapinutiac to Tarionayaliiai 
of & in Sboppord’s method of uoUke sigmt 
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the formula. For this purpose Table LIX is presented. The 
value of the fraction in the formula for the case employed 
above is .3747. The entry in the table nearest to this is .376, 
for which the corresponding value of r is .38, the same as that 
obtamed by looking up the cosine. 

Sheppard's method of unlike signs. Sheppard has gone a 
step further and suggested a still simpler method of securing 
the coefficient of correlation for fourfold tables. His method 
yields a result that approximates the one given by Pearson’s, 
but obtains it with considerably less work. The formula he 
suggests * is r = cost/ 180° In this formula U stands for the 
per cent of all measures having unlike signs or, in other words, 

U = — IT—. For the data already used several tunes in this 
N 

chapter U equals — or .375. Therefore r = co8.375T80° = 

00807.5° = .38. In this case, however, just as in that of Peai> 
son’s method, it is not necessary to find the actual cosine, but 
the value of r may be determined du-ectly from that of U. 

Since U is equivalent to the same table serves for this 

purpose as for Pearson’s method. From the table one can find 
that the value of r most nearly correspondmg to a value of 
.375 for U, IS .38, the same as that already obtamed. 

As may be seen by lookmg up the standard or probable error 
of this coefficient given m Chapk^r XIX its reliability is not 
very high. Unless the value of r is .50 or more and the number 
of cases fairly large httle significance should be attached to it. 

The coefficient of contingency. Probably the most common 
mfthod of measuring the correlation of attnbutes when the 
classification is more than twofold ’’ is Pearson’s coefficient of 

• fThis formula in denved liy substituting m Pearson's formula. For 
V'Se U is substituted and for L (L equals the per cent of cases having 

U 

like signs). Thus the formula becomes r »• cos ^ ir. Since, however, 

L-4- V Ib always 100 and r equals 180°, it reduces to the form given 
above. 

method may also be used with a twofold classifieation but it ia 
not common to do so. 
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mean-square-contingency. This assumes that the cases have 
been tabulated m a table similar to a correlation table. It is 
similar also to a dichotomous table, except that it may have 
any number of divisions, and the number of classes in which 
one variable is grouped need not be the same as the numbo: 
in which the other is grouped. Table LX, which contains data 
showmg the relationship between average mark and major 
subject, illustrates the method of tabulation and computation. 
Part A thereof contains the data as they should be tabulated. 

The formula eiven by Pearson for meaii-square-contmgency 
(usually abbreviated C) is 


(x = cht and <j) — phi) In this formula. 



in which n, represents the total number of measures m a given 
row of the table, the total number m a given column, and 
nrc the number m a given compartment.* One familiar with 
the theory of probability will see that what the fofmula does 
is to compare the number of cases in each compartment of 
the table with the number that might be expected to fall thero 
by pure chance. 

Yule has shown that Pearson’s formula may be simplihed 
to the followmg: 

' It will be noticed tiiat in the example given the knee bounding the 
comjiartnients have not Ijeen innerted. 
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TABLE LX 

COMPXTTATION OF TBE CoBFFICIBNT OF 
Mean-Squabb-Contingbnct 


Past A 

Mark 

Major Subject 

Total 

Eng. 

Hut 

Math. 

For. L. 

A 

2 

2 

3 

3 

10 

B 

6 

5 

4 

5 

20 

C 

8 

5 

4 

4 

21 

D 

4 

3 

1 

1 

9 

Total 

20 

15 1 

12 

13 

: 60 

Paht b 


4 

4 

9 

9 


20 X 10 

15 X 10 

12 X 10 13 X 10 


36 

2.) 

16 

25 


20 X 20 

15 X 20 

12 X 20 13 X 20 


64 

25 

16 

16 


20 X 21 

15 X 21 

12 X 21 13 X 21 


16 

9 

1 

1 


20 X 9 

15 X 9 

12 X 9 

13 X 9 

Part C 


.0200 

0267 

.0750 

0692 



.0900 

0833 

0667 

0962 



.1624 

.0794 

0635 

0686 



.0889 

0667 

0093 

0085 



C = 

/l 0544 - 1 

23 



10644 


Pabt D 


20U0 20 21 9 y 


25 M _9 \ 

■r ot + g y 


.2560 


±(± + 

16V10 ^ 20 ' 21 

Mra+S+ii+T)- •“'« 

n(ro+i+li + -r)- •»“ 

T - 1 0642 
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TABLE LX — ConUrmed 
Pash E 

fo(s + f5 + H+f3)- 

id+S+H+i)- 

1 /64 , 25 . 16 . 16\ ^ „„„ 

21(20 + 15+12 + 13; ” ^ 

1 /16 , 9 , 1 . 1 \ 

9 (20 + 15 + 12 + 13/ 

T = 1 0543 


in which 



For actual computation it is advantageous to make a slight 
change in the formula for S by changing the position of N m 
that 


5 = iVS 



This is the formula commonly recommended and employed 
for computing the coefficient of contingency. It is, however, 
possible to mtroduce a further simplification If both numera- 
tor and denominator of the formula just given are divided by 
N the result is 


C = 



in which * 


T = 



8 

^W 


This is the form recommended by the writer. 

* It may be noted that 

X* - 5 - JV - Afcr - 1 ) and ♦» - - T - 1 . 

iV 
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The application of this formula is Ulustrated in Table LX. 
The first step is to substitute in each compartment the fraction 
called for by the formula instead of the actual number of cases. 
This is done m Part B of the table. Each numerator is the 
square of the number of cases m the compartment, and each 
denominator is the product of the number in the column and 
the number in the row in which that compartment falls. Thus, 
for example, takmg the upper left-hand compartment, the 
number of cases is 2, and so the numerator of the fraction is 
2* or 4. The number of cases in the left-hand column is 20 and 
in the upper row 10, so the denommator is 20 X 10. Part C 
contains the same fractions reduced to decimals The entries 
in this are then summed as the formula calls for, givmg 1.0544. 
This is T, 80 substituting m the formula gives 



In other words, the relationship between the average marks 
and the major subjects of the sixty pupils whose records are 
dealt with is quite small. 

A further shght simplification of the method just illustrated 
is posable. In Part B of the table there is a common factor in 
the denominators of all fractions in each row or column. Thus 
20 appears in the denominator of each fraction m the first 
column, 15 in that of each in the second, and so on. Sunilarly, 
10 appears in the denominator of each fraction in the first row, 
20 in that of each in the second row, and so on. One may there- 
fore take out the common factors for all the rows or all the 
eolumns, as he prefers. If this is done by columns Part B may 
be rewritten as ihown in Part D. If the fractions m the paren- 
theses are changed to decimals, added, and multiplied by the 
<)onunon factors, the four rows of the table give .3613, .2560, 
•J2144, .2326, respectively. Adding these, 10542 is obtained, 
which differs from the result already secured, 1.0544, merely 
beo&oae enough decimals were not carrier|^- ’ 

This may be checked, if desired, by doing the same thing 



THE CORRELATION OP ATTRIBUTES 


3i» 


by rows instead of columns. The result, shown in Part E, is 
1.0543, approximately the same as before. 

The value of C is always positive and ranges from zero to 
somewhere near 1.00. Unless the number of classes is infinite 
its value cannot be 1 00; instead, the maximum value depends 
upon the number of classes, being greater the larger this num- 
ber is. This limit is given by 



(ni — l)(n2 — 1) 
nirii 


in which Wi and nj represent the numbers of classes in the two 
Senes of measures. Thus if there are two classes of each variable 
C cannot exceed .71; if there are three classes of each it cannot 
exceed .82; if there are four, .87; if there are five, 89, if there 
are ten, 95, and .so on. Because the possible value of C is limited 
in this way it has been suggested that the coeflficient of con- 
tingency should not be used unless there are at least five classes. 
The wnter, however, docs not agree with this recommendation, 
but suggests instead that it be used and a correction applied 
to allow for the number of classes. 

An approximate correction for this purpose may be made 
by dividmg the actually obtained value of the coefficient by 
its maximum possible value as given by the formula. Thus, 
in the example used, the maximum possible value of C is given 

by y ^ 7 which equals 87. If the computed value 

of C, .23, is divided by 87, the result, .26, is a corrected value 
of C which is roughly comparable with the product-moment 
coefficient of correlation. 

Probably a better but a more difficult oofrection may be 
made by dividing the obtained value of C by the product erf 
the coefficients of correlation of each of the two series of meas- 
ures with the mid-point values of the classes. If the mea^res 
are attributes this correction is of doubtful validity, but if one 
or both are Variabtiyiiit is appropriate. The method of deter- 
mining the coefficieim of correlation mentioned may be found 
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in both Holzinger and Kelley, “ who also give fuller discus* 
sions of some other points than are to be found here. 

A correction for too fine grouping which, however, cannot 
be applied when the value of T and also that of N is small, 
without resultmg in an urational expression is to subtract 

~ froni the obtamed value of T before using 

it in the formula for C. As is apparent when it is attempted, 
the example used above is a case in which the result is irrational. 

It has been pomted out by certain wnters that there are 
certain limitations which apply to the use of the coefficient of 
contingency. There has been some argument concerning these 
but it seems reasonably safe to conclude that in most cases m 
which the ordinary reader is interested these limitations are 
not serious. Discussions of them may be found m a senes of 
articles by Hams and others, and Pearson 

Product-moment correlation for qualitative series. Instead of 
Gomputmg the coefficient of contingency m cases involving 
non-numencal or qualitative data, it is possible but not com- 
mon to compute the product-moment coefficient of correlation. 
This may be done m cases involving one qualitative series and 
another quantitative senes, and hkewise in cases in which both 

» Kar l J. Holzinger, Statisliral Methods for Students tn Edueatvm (Bo»- 
ton, Ginn & Co., 1928), pp 273-278 

“ Truman L Kelley, op cit , pp 265-271 
J. Arthur Harris and Alan E Treloar, " On a Limitation in the Ap- 
plicability of the Contingency Coefficient,” Journal of the Ameruxtn Statis- 
tical Assoevatum, Vol 22, December, 1927, pp 460-472. 

J. Arthur Hams and Chi Tu, “A Second Category of Limitations m the 
Applicability of the Contingency Coefficient,” Journal of the American 
Statistical Association, Vol 2i, December, 1929, pp. 367-375. 

On the Theory of Contingency 

Karl Pearson, "Note on Professor J Arthur Hams’ Papers on the Limi- 
tation in the Applicability of the Contingency Coefficient,” Journal of 
the American Slalistical Association, Vol. 25, ^ptember, 1930, pp. 820- 
323. 

J. Arthur Harris, Alan E Treloar, and Marian Wilder, "Professor 
Pearson’s Note on Our Papers on Contingency,” Journal of the American 
fhatietical Association, Vol. 25, September, 19%, pp 323-327. 

' Kari Pearson, “Postsenpt,” Journal of the American StfUntical Associor 
Son, VoL 25, September, 1930, p. 327. 
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series are qualitative. It involves the assumption of a normal 
distribution, so unless this condition holds approximately its 
use is not legitimate. The first step in the process is to convert 
the qualitative data mto quantitative terms according to the 
assumption that they form a normal distribution. After this 
has been done the coefficient of correlation may be computed 
either in the ordinary way or by means of a formula adapted 
for use with data on the normal scale, which renders the compu- 
tation somewhat simpler. It rarely occurs that the ordinary 
worker in education has occasion to make use of this method, 
and so it will not be explamed here. Since the method of trans- 
muting a qualitative senes into a quantitative one is given in 
Chapter XXI, however, the reader can make use of that and 
the ordinary formula for r if he desires to compute the value 
of r between a quahtative and a numerical senes, or between 
two qualitative senes The adaptation of the formula for use 
with data on the normal scale and the calculation of r based 
thereon may be found m Holzinger.'* The same author also 
deals with the computation of ratios of correlation for such 
senes. 

The bi-serial coefficient of correlation. A special case, which 
sometimes occurs, is one that involves the correlation between 
two traits, one of which is an attnbute with only two classes 
and the other a variable with a number of numencal classes. 
Thus, for example, the correlation between sex and school 
marks may be desired, or that between race, when only whites 
and blacks are concerned, and intelligence If the distribution 
of the attribute is approximately normal the bi-senal coeffi- 
cient of correlation is probably the best measure of this re- 
lationship to employ. It yields a value comparable with that 
of product-moment r for an ordinary correlation table exc^t 
that it may exceed ±1.00 if the distribution concerned is next 
normal. 

Probably the best formula for computing bi-serial r is that 
suggested by Kelley, although another is employed by som^ 

*' Kari J. HoIsiikg«ii|#p. ctl., pp 260-270. 

i< Truman L. KeUey, op. ctl.,_pp. 245-240. 
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statisticians.’* Kelley’s formula, with the notation modified 
somewhat, is as follows; 


bi-serial r = 


(Afp - M^pq 
Ojf X .3989fc ■ 


In this p and q are used as is common m the mathematical 
treatment of proportions, p oqualinR the fraction of the total 
number included in the largi'r of two portions into which the 
total is divided, and q the fraction included m the smaller of 
two portions. Thus p q — i h is the altitude of the nor- 
mal curve at the distance from the mean or center that m- 

eludes the fraction of the area under the curve equal to — g — 

or p —.5. It may be found from Appendix B by finding the 
height corresponding to the given area. 


TABLE LXI 


Computation op Bi-Serial r 


M ark 

Hoyi 

O’trh 

Total 

i 

A 1 



5 

B 



11 

C 



16 

D 



11 

E 



7 


1 20 1 

1 30 i 

50 


(2 97 - 2 8,5) 6X4 
115 X 3989 X .9683 


The computation of bi-senal r by this formula may be illua- 
^ted by the example given in Table LXI. The data in this 
table show the .school marks made by a group of 60 pupils 
divided according to sex. It is assumed that the five letter 
marks used represent quantitative values with equal class 
Since the number of girls is greater than that of boys, 

' 

n MH. L. lUetz and others, Handbook of Mathemalical SUUuHai (Boston, 
jfibnqditoii MifSm Co., 1924), pp. 136-137. ' 
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tile proportion of the total group the girls represent is p and 
the proportion of the total the boys represent is q. Therefore 


V 




Giving numerical values to the 


marks, 1 for E and so on up to 5 for A, we find the mean mark 
for the girls to be 2.97, and that for the boys 2.85. Cni 
standard deviation of the total group, is 1.15. The area for 
which the height of the normal curve is desired is .1, since 
p = .6 and therefore p — .5 = .1. Looking up this area in 
Appendix B, the correspondmg height is found to be approxi* 
mately .9683.*® Substitutmg these values m the formula, we 
obtain 


^ , (2 97 - 2 85) 6 X4 

bi-senal r 39^9 9983 


= .06 


This may be interpreted to mean that there is a very slight 
positive tendency for girls to have higher marks than boys. 

One use of the bi-scnal coefficient of correlation tliat should 
be mentioned is in connection with the validation of test ele- 
ments. The procedure in so doing assumes that the total score 
on a test may be taken as valid, or at least as the most nearly 
vahd criterion at hand, and that the validity of each single 
element composing it may be determined by finding the bi- 
senal coefficient bi'tween nght and wrong answers thereto and 
score on the whole test. The lugher the resulting coefficient, 
the better the element. 

It 18 possible not only to compute a bi-serial coefficient of 
correlation, but likewise a bi-senal ratio of correlation. This 


“ To find the height the pniees.'i of interpolation must be used. The 
nearest entrv to .1 in the area column of the sigma tdble is 0987 and the 
next entry above this is 1179 The difference between these is .0192 ami 
the difference between .0987 and the desired area, 1000, is 0013. ThcM- 
fore one must subtract from 9692, which is the height of the curve oone- 

sponding to an area of 0987, of fh® difference between this height and 

that corresponding to the next area Smee the next height is .9500, thin 
13 

difference is .0132, and — thereof is approximately 0009. Subtaracting 
thisidibtmt from .9692 gives 9683, the desired height. 
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is so rarely needed by the ordinary teacher or other worker in 
education that it will not be explained here, but may be found 
in Kelley.” 

The ratio of correlation. Another possible means of measur- 
ing the correlation between a series of data treated as attributes 
and another treated as variables is the ratio of correlation. This 
measure has already been presented in Chapter XIV as a means 
of measuring the curvilinear relationship between two series 
both of which are variable in their nature. The use of the ratio 
in educational work has been almost entirely limited to two 
series of variables, but there seems to be no good reason why 
this should be true and at least a few workers are making use 
of it in situations of the other kind. An examination of the 
formula for reveals that the only variable concerned is X, 
and one of the formula for »}„i that the only variable concerned 
is Y. Because of this fact, it is immatenal to its computation 
whether the other characteristic concerned in the correlation 
is a variable or an attribute. Since the method of computing 
it has already been given m Chapter XIV it will not be re- 
peated here. It may, however, help the reader to consult an 
account of a study in which it was employed in this way; so 
for this purpose the reference below is given.'* 


ExsaasEs 

1. Compute Q and w for each of the following sets of data' 

A. Individuals above average in both height and weight — 37, 

above in height and below in weight — 15, below in height and 
above in weight — 12, below average in both — 36. 

B. Number above m both — 17, below in both — 15, above in first 

and below in second — 4, below in first and above m second — 6. 

2. Compute the coefficient for each of the sets of data in Exercise 1 
by Pearson’s cosine t method and by Sheppard’s unlike-eigns method. 

3. Compute the coefficient of contingency for each of the following 
sets of data; 

n Truman L. KeQq^^Bcit., pp. 249-253. 

w Wilhelm Reits, 'Techniques for the Study of Institutional 

IMEerences,’’ Jourtuil iKkpenmmtal Educattan, Vol. 3, September, 1034, 
1^ 11-24. 
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A 


Mark 

School 

Frankhn 

Jefferson 

Lincoln 

Porter 

WashingUm 

A 

3 

4 

2 

5 

1 

B 

5 

6 

7 

12 

6 

C 

8 

12 

11 

23 

8 

D 

3 

6 

5 

8 

3 

E 

1 

2 

3 

2 

2 


B 


Subject 

Nationautt 

Native-Born 



Polish 

Elnglish 

23 

6 

5 

4 

Foreign language 

7 

0 

8 

3 

Mathematics 

8 

1 

2 

1 

Science 

12 

4 

3 

3 

History 

18 i 

6 

12 

4 


4. Correct the ^ aloes of the coef&cient of contingency found in 
Exercise 3. 

5. Compute bi-senal r for each of the following sets of data: 


A 


Intslliobnce QroTncHT 


Sex 

70- 

SO- 

90- 1 

too- 

110- 

igo- 

130- 

140- 

160- 

Boys 

2 

5 


18 

6 

4 

1 


1 

Girls 

1 

6 


16 

8 

3 

2 ! 

2 



B 


WtJOBT 



66- 

70- 

75- 

80- 

86- 

flP- 

96- 


105- 

no- 

116- 

lao- 

Superior 


1 


2 

3 

6 

15 

22 

14 

11 

5 

1 

Inferior 

2 


3 

3 

5 

9 

24 

26 

13 

9 

6 








































CHAPTER XIX 

RELIABILITY 

Introduction. When considered from certain standpoints any 
measure of central tendency, variability, relationship, or other 
statistical charactenstic of a std of data is subject to a certain 
amount of unrehabihty. In general this unreliability is due to 
one of two causes. It is frequently impossible, or at least im- 
practicable, to measure all individuals composing the total 
population or umversc, as it is called, which one desires to 
measure. In such cases one must select a sample which is taken 
as representative of all individuals m the specified group. Fre- 
quently also the measures are merely a sample considered 
representative of all similar measures The errors ansing from 
this cause are called errors of sampling. The other cause of 
unreiiabihty is that the measures themselves are rarely per- 
fectly accurate, but contain errors due to imperfections m the 
Ineasurmg instruments used or to errors m their apphcation. 
These are called errors of measurement. 

It is commonly impossible to determme the error of either 
sampling or measurement m a single score or measure, but the 
number and size of such errors existmg m connection with a 
set of data can ordinarily be estimated. Smce such errors form 
distributions that in most castes approximates normal distri- 
butions centering around zi-ro with half of the errors positive 
and half negative, it is customary to describe the size of errors 
or, conversely, the rehabihty of given measures, by stating a 
jneasure of variability of the distnbution of errors therein. The 
two most comnton measures used for this purpose are the 
standard error and the probable error. The standard error is 
the standard deviation of the errors, or, in other words, the 
error (rf such a size that approximately 68.27 per cent of all 
tto errors are less than it and the remaining 31.73 per cent 
^g^ter. The probable error is the median deviation of the errors, 
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that is, the error of such a size that half of the errors are smaller 
and half are larger. Just as the median deviation is equal to 
.6745 times the standard deviation, so the probable error is 
equal to .6745 times the standard error. The standard error 
is commonly abbreviated by <r, just the same as the standard 
deviation, although a few wnters use t (epsilon) ; and the prob- 
able error, by PE. Sometimes the mean error, which is the 
mean deviation of the errors, is employed, and very rarely some 
other measure of error is used. 

Fonnuise for errors. The formulEP ordinarily given for the 
errors mvolved m various measures include both errors of 
sampling and those of measurement. These formula; for prac- 
tically all of the commonly employed statistical measures and 
also for some h'ss frequmitly used are given m Tables LXII 
to LXV. These tables giv(> the standard errors of the measures 
named at the left Thus the standard error of the mean, the 

ff 

first entry m Table LXII, is til tbe median, the 


1.2533 and so on. 
v-V 


In each case the com- 


oext entry, is 

spending probable error can be obtained by multiplying the 
standard error by 6745. To .save the reader the labor of com- 
putation, the numiTical coefficients of the various formulae 
(when they are other than umty) have been multiplied by 
.6745 and the results given in parentheses. When this has not 
been done it is understood, of course, that .6745 is to be used. 
For example, in the first entry in Table LXII, the standard 
<r 

error of the mean is 




Smee the numencal coefficient of 


this is unity, the coefficient for the probable error is .6745 and 
so is not given. For the second measure m this table, the median," 
the coefficient of the standard error is 1 2533, hence this has 
been multiplied by .6745 and the result, 8453, given in paren- 
theses. This means that the probable error of the median Is' 


* The prob^fe error may also be obtained in a somew^iat 
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TABLE LXII 

Stanbabd and Probabui Errobs or Certain Averages and Otbkb 
Point Measures 


Measure 

Error 

Mean (AT) 

<T 

Median (Afd) 

1.2533-^ 

{8453)*v^ 

First or third quartile (Qi or Q,) 

1 3626— 
(.9191) 

Tenth or ninetieth percentile (Pw or Pic) 

1 7094-^ 

(1 1530) vAT 

Twentieth or eightieth percentile (Pm or Pu) 

1 4288— 
(9637) vN 

Thirtieth or eeventieth percentile (Pu or Pro) 

13180— 

^ ( 8890) V N 

j^ortieth or sixtieth percentile (P« or Pu) 

Any percentile (P*) 

12680-^ 
(8553) vA^ 

_£_t 

1 yp Vn 


*Aa explftined more fully on pace 327 tbe number m parentheses is the numerical eo- 
to be used for the probable error instead of the one given m the formula, which is 
for the standard error In case no n\ieb roefficient is Riven id parentheses it is 6745 

fThe appeanog; Ui this formula ts the height of the curve at the peroentile desared, 

Mpresesd in terms of total area -> 1 00 and ^ * 1 00 It may be found from the sigma table 
in Ag^wndix B by multiplying the height corresponding to the given percentile by 3989. 


different manner in those cases in which <r, the standard devia- 
tion, appears in the fonnulae for the standard error. This is 
merely to substitute the median deviation for the standard 

<teviation. To illustrate, the standard error of the mean ifl“^* 

VN 

therefore the probable error of the mean is — 7 ??' which, 

y/N 

a 

of course, is the same as .6745 

Jn presenting the formulae in Tables LXII to LXV the writer 
hpe not attempted to give references showing the various 
Sooioes from which most of them have been secured. Some of 
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TABLE LXIII 

Btandard and Probabui! Ebbobs of Certain Measttbes or 
Vaeiabii-itt * 


Measure 


Error 


Quartile deviation (Q) 

10- 90 percentile range (D) 
Mean deviation {MD) 
Standard deviation (<r) 
Median deviation (MdD) 
Coefficient of vanability ( V) 


a Q 

7867— or 1 1664-^ 

( 5306)^^^ (.7867) vAT 

<T D 

2 2792-7= or .8892- 


{1.5373J 


VTV 


(.5998) 


VN 


.6028-^ or 7555^ 
(.4066) viV (.5096) V)V 


or 7071-—= 


( 4769 )''^ ^ 

.6745-^ or .4769-^ 
(.4549) V2)V (.3217) VW 


V 


” 1/ 


V 

7071-=, 
(4769)V^' 




* Tb« errore given in this table and thoee of any other difTerencea betweeD pereeatilat 
and other puinu in a distribution are obtained b> the application of the fonnula for the 
error in the sum o r dif fereoce of two correlated vanablee given m Table LXV Tlie r need 

in eo doing m a/ EiZ.', m which pi and are the per cents of oasm above and beioer one per- 
y PiOi 

eentile point, and pi and qt those above and below the other If the two percentile pointe 


era equidwtant from the median, pi » gs and pt 




> ai. so that r a tn which p if the 
0 


■mailer per cent of cases and q the larger Thus, the formula for the standard ernw 
iflei 

+<rl 


of the difference between two (>ercenti1ies at the aanie distance from the median if 


ff , 

a P Q 


which, Since sampUBee to ■y/iop - 2^^ 


2 ~ 2^ A table of euch errors for a number of common mter-peroenttle raagM ex- 
V ^ fl 

pmwcrl as fractions of the range to which each apphee has been woriced out by Mastvn 
and Upshail. Harry V Masters and C C Upehail ' Table of J’xebable Erronrto 
Certain Inter* Percentile Ranges." Jimrnof of Bducctumat pKychoioffjffyci 23, Apnh 
pp 287-290 

t As explained more fully on page 327 the number in parentheses is the numeneal 
effioiMit to be used for the probaoio error instead of the one given m the formula, whidl if 
for the standard error. In case no such coefScueut is given in parentheses it is .0745. 


them have been in common use for a number of years, whereas 
others have been derived very recently and in some cases 
are even yet open to question. The reader who is interested in 
the denvation of these formulae and also of others not givaa 
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OOTT / I 

•Thi» fonnuitt may be wntten m the form H + • 

^xy 

Hxe quantities A^ ^ and Ay y may then be found in a table euoh as that given by Truman 

L Kelley, in 5fatt«<tcal Mtihod (New York. Macmillan Co , 1923), p 211 
t As explained more fully on page 327 the number in parentheses is the numenoal ooe6l' 
cient to be used for the probable error instead of the one given m Uie formula, which is for 
tlw standard error In case no such coefficient is given in parentheses it is 6746 

t There has been considerable disousxion concerning this formula The reader who it 
interested is referred to the following articles 

Bugene Sben, “The Standard Error of Certain Estimated Coefficients of Correlation,'* 
JouTT^ of Bducaixonal Piucholooy, Vol 15, October. 1924, pp 462 -465 

, *‘A Note on the Standard Error of the 8pearman>Drown Formula," Journal of 

Bducattonal Ptychoiofiyt Vol 17, Februar> . 1926 pp 93-94 

Earl J Holeinmr and Blythe Clayton. ‘ Further Experiments in the Application of 
Spearman’s Prophecy Formula," Jmimal oj Edxicahonai Psychology, Vol 16, May, 1625, 
pp 28&-299 

Harl R Douglass, “A Note on the Correctnees of Certain Error Formulas." Journal of 
Bdueahonal Psychology, Vol 20, September. 1929. pp 434-437 

Karl J Holsinger, “A Note on the C'orreetness of Certain Error Formulas," Journal of 
Bdueahanal Psychology, Voi 20. Oeceniber. 1929. pp 669-670 

Harold A Eogerton, "A Table for finding the Probable Error of R Obtained by Use of 
the Spearman-Brown Formula (n « 2)." Journal of Applied Psychology, Vol 14, June, 
1930. pp 206-297 

I Edward E Cureton, The Standard Error of the Spearman-Brown Formula When 
Used to Estimate the Length of a Feat Vecea^ary to Achieve a Given liehabiiity," Jtmmaf 
of Bdueaiional Psychology, Vol 24, April 1933 pp 305-306 

II For further discussion of the crrom of multiple correlation coefficients, see Mordeeai 

Eidciei. "The Application of the Th«K>rv of lirror to Multiple and Curt'ihneaT Correlation,’* 
Procssdxngs of ike American AssocuUxon, Vol 24 March, 1929, pn 99-104, 

Mark H Ingraham. " Dimcuskiod," Proceedings of the Ammcoo .StoltJiftcaf Assoctaiumt 
Vol 24, March, 1929, pp 105-107 

^ The formula given above for the error of bi serial r is an approximation that doee not 
yield results as near true talues. obtained b> using a roDHidcrably longer formula, as do 
most of the approximate error formuin* given in these tables In the following reference a 
method of determining a much closer approximation b> the use of nomographs is^ven* 
Walter J McNamara and Jack W Dunlap A Graphical Method of Computing the Staod- 
krd Error of Biaenal r," Journal of Ezpcnmental Bducalxon, Vol 2, March, 1934, pp 274- 

wn. 


here is advised to consult Holzmger,* Kelley,* Yule,* and Eze- 
kiel,* where he will find either discussions or references on 
practically all of them 

At the beginning of this section it was stated that the for- 
mulae given in Tables LXII to LXV include both errors of 
sampling and errors of measurement. As has been shown by 

‘ Karl J Holzmger, Slatishcal Methods for Students in Education (Boston, 
Ginn & Co., 1928), Cb. mi, and elsewhere. 

• Truman L. Kelley, Statistical Method (New York, Macmillan Co., 
1923), pp. 82-92, and elsewhere m connection with measurea m which 
errors apprar. 

** G. Udny Yule, An Introduction to the Theory of Statistics, ninUi edition, 
lefised (London, Charles Gnffin & Co., Ltd., 1929), Cha. xiii, ithr, and 
imL * 

* Mordeeai Ezekiel, Methods of Correlation Analysis (New Yoikt^ohn 
Wikiy & Sons, 1930), Chs u, vii, xiu, xv, xvui, Appendix 2, aiM ilse 
where. 
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Kelley ® and Huffaker and Douglass * the error of sampling 
may be secured by multiplying the proper formuUe in the table 
by y/r, and the error of measurement by multiplying it by 
y/l — r. For example, the formula for the standard error of 

the mean is Therefore that for the standard error of 


samphng of the mean is and that for the standard error 

VN 


of measurement of the mean is 


VN 


It will be noted that in most of the formula VN appears in 
the denominator In other words, the standard or probable 
error of a measure usually vanes m inverse proportion to the 
square root of the number of cases upon which it is based. This 
means that it is possible to reduce the size of the error to any 
desired amount by increasing the number of cases, provided 
that it 18 possible to do so sufficiently. For example, if a stand- 
ard error has been determined for a measure based upon fifty 
cases and it is desired to reduce it to one-half its onginal size, 
this can be done by employing four times as many cases, that 
is, two hundred. If it is desired to make it one-third as large, 
nine times as many cases, or four hundred fifty, must be used, 
and so on. 

Although VN appears in many denominators it is not strictly 
accurate to employ it. Instead, as a general rule, the expres- 
sion VN — 1 sliould appear. However, it has become so com- 
mon in educational practice to employ merely VN, and in 
most cases the resulting difference is comparatively so small, 
that it is probably desirable to conform to general practice 
rather than to exact mathematical precision. Moreover, the 
use of VN — 1 is not entirely vahd in all cases. As a sort of 
compromise between secunng greater accuracy than that given 


• Truman L. Kelley, “Note upon Holzinger’s Formula for the IVobaUe 
Error,” Journal of Educational Psychology, Vol. 14, September, 1923, 
37(t-37T. 

• C.- 1^ Huffaker and Harl R. Douglass, “On the Standard Erron of 
the SfiH Due to Sampling and to Measurement,” Journal of Educatianat 

10, Dwember, 1928, pp. 643-649 
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TABLE LXV 

Standard and Frobabue Errors of Curtain Miscxllanxohs 
Measures 


Measure 


Skewness (gUtf - 
Skewness ^Md — ^ 


Eurtosis 

Coe£Scient of regression, X on Y, 

( 6 *,) 

Coefficient of regression, Y on A', 

(b».) 

Partial coefficient of regression 

(6u.« . . . n) 

Sum or difference of two corre- 
lated variables ( ± P) t 

Sum or difference of two uncor- 
related variables {X ± P) t 

Difference of two sigma index 
scores of same individual 
(A. - Zy) 

Per cent of one distnbution ex- 
ceedmg median of another 

Observed frequency m a dis- 
tribution (/) 

I, 

Observed percentage frequency 

(/r) 


Error 


3 12247 ( 8260)* 

2N viv 

a D 

1 3290— or .6185^ 

(8964)VN (.3497)" 

( 1874) 

.2778 

■\/N 



V| » n 
VU4 .n->/N 


V^vi -4- ajS ± 2riyV iVy t i 

y/ a I + ay 5 


V'2 - rx,X, - Ty^y^ 

.25 II 
NiAT, 


/pdOO -/,) 
N 

i/I 





proportion (p) or (9) 
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Measure 


Error 


Pair of equivalent test elements 


y 21 N N J 


Achievement or accom- 
plishment quotient 
(A.Q.) 


"EQ ot IQ 
MeQ or IQ 


V2 - ’’aQ ^AQ, 


— •• 


* As enplaiued moro fully on paxe 327 the number in parentheeeR is the numencal eo 
efficient to be used for the probable error instead of the one in the formula, which is 
for the standard error In cnee no such coefficient is Riven in parentheses it is .6745 

t tSee page 360 and foliowinR for a discussion of these formuliP A graphic method of 
solving the latter is given in Harold A ICdgerton. ‘ A Graphic Method of Finding Standard 
Errors and Probable Lrrora of Differences." Journal of /ir'ducaboncii P$ycholof/y, V'ol. 23. 
January. 1932, pp 56 57 

t A plus sign IS used before the U'lt term if a sum is being dealt with, a minus sign if a 
difference is concerned 

ft Tbetr's in Uiese formulic arc the landarderrorsof the quantities cootnbuung tothesum 
or difference 

in this (ormulu stands for the number of cases in the dislnbution for which the per 
cent IS taken, and \ t for the number of laaes in the other distnbution 

^ In this forrauta n is the number of pupils missing the element in one form of the test 
and answenng corre<^tl> the currcspionding element m the other fomi. and d the number 
answering it coiTe<'ti\ in the rir'<t and missi^ it m the second The denvation of this 
formula may be found in Kar! J HoUinger. ' The Ueliabilit.v of a Single Test Item." Jour- 
nal of Educational i^tn/rfudono \ol 23. '^pteinber, 1932 pp 411-417 

The achievement or accomplishment quotient equals the educational quotient {£ Q.) 
divided by the intelligence quotient {IQ) In Uie formula a and Af of the same quotient 
must be taken 


by using VlV and making no attempt at all to do so it has been 
suggested that if there are from twenty to thirty cases involved 
•s/N — 1 be U8<.*d mrtead of y/N, that if there are from toi 
to twenty cases involved %/,V — 2 be used instead of VjV, 
and that if there are less than ten cases VA' — 3 be employed. 

In addition to correcting denominators of measures of unre- 
liabihty for small numbers of cases they should also, if one 
desires to be accurate, be corrected for the number of variables 
concerned. The general nile for this is that the denominatOT 
in the formula for a measure of unrehabihty should be y/N — n, 
in which n stands for the number of variables Thus, for a 
measure of central tendency or variability denved from a 
distribution of a smgh' vanable, the denominator is y/N — Ij 
for a measure of simple correlation or regression that involves 
two variables it is y/N — 2, for one of partial or multiple cor- 
relation or regression involving three variables it is VAT -r Sj 
and so on up. 

For a fuller discussion of the unreliability of measures of 
correlation and regression the reader is referred particularly 
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to Ezekiel ’ and Fisher,* also to Bowley,* Shewhart,*® Wilson,** 
and Baker.** These writers deal especially with the reliability 
of measures of correlation for small numbers of cases. 

Systematic and variable errors. From one standpoint the 
errors present in any set of measures or scores may be classified 
into two groups: systematic, constant, or group errors; and 
variable, accidental, chance, or individual errors. A constant 
error is strictly defined as one of the same magnitude affecting 
all the scores of a given group Such an error causes all the 
scores of a group to be too high or too low by the same amount 
or in the same ratio. In educational measurements, however, 
an error which exactly fulfills this condition is found rarely. 
Instead, there may be errors that are in the same direction and 
tend to be of about the same magnitude, either absolute or 
proportional, for a given group of scores. Since these errors are 
not really constant or uniform, the use of systematic instead of 
constant seems desirable. For examph', if the person giving a test 
allows too much time it is highly probable tliat all those taking 
the test will make higher scores than if only the correct amount 
of time is allowed, and that the increases m scores will tend 
to be proportional to the ongmal scores. Thus, if the time 
limit is supposed to be twenty minutes and twenty-two are 
allowed, there will be more or less of a tendency for each pupil 

• Mordecai Ezekiel, Methods of Correlation Analysis (New York, John 
Wiley & Sons, 1930), Chs xvni and xix, and Appendix 3 

• R. A. Posher, Statistical Methods for Research Workers, third edition — 
revised and enlarged (Edinliurgh, Oliver and Boyd, 1930), pp. 139, 158- 
171, 176. 

• A. L Bowley, “The Standard Deviation of the Correlation Coefficient,” 
Journal of the American Statusiical Association, Vol 23, March, 1928, pp. 
31-34. 

“W. A. Shewhart and 1'’ W Winters, "Small Samples — New Expen- 
mental Results,” Journal of the American Statistical Association, Vol. 23, 
June, 1928, pp. 144-153. 

“Edwm B Wilson, “Probable Error of Correlation Results,” Pro- 
otedsnys of the Amenean Statistical Association, Vol 24, March, 1929, pp. 
90-03. 

” George A. Baker, “The Significance of the Product-Moment CoeflS- 
etent of Correlation with SfK.-cial Reference to the Cliaractcr of the Mar- 
ginal Distributions,” Journal of the American Statistical AsaoctcUum, Voi 
Dec^ber, 1930, pp. 387-396. 
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to do about 10 per cent more rrork and thus make a 10 per cent 
better score than if the extra two minutes had not been allowed. 
To give a second example, if a teacher has in mind that an 
English composition of a certain degree of merit is just good 
enough to deserve a passing mark, whereas in the judgment 
of more competent persons such a composition deserves a mark 
of 5 per cent above passing, it is probable that most of the marks 
given themes by this teacher will tend to be about 5 per cent 
too low. Such errors are evidently systematic and so may well 
be called by that name. 

Variable, accidental, or chance errors are those that differ 
for the different mdividuals of a group and have no tendency 
to be of the same magnitude or m the same direction. If one 
pupil of a group taking a test happens to have studied recently 
the particular points covered by the test and therefore makes 
a better score than would usually be the case; if another pupil 
just happens not to have studied recently some of the points 
covered by the test and therefore drops lower than usual; if 
one pupil IS in excellent mental and physical condition and as 
a result makes the best score possible for him ; if another pupil 
18 decidedly below par, and thus does not do nearly so well 
as usual; if a pupil breaks his pencU point and does not have 
another pencil handy, if a pupil seated near a wmdow has his 
attention distracted by soraethmg out of doors; if a pupil 
secures help by glancing at his neighbor’s paper; or if any of 
many other possible conditions that affect one or a few pupils 
differently from most of the group obtain, the result is one or 
more variable errors. 

In practice it is sometimes possible to discover and make 
approximately correct allowances for sj'stematic errors, but 
this can rarely if ever be done for variable errors. Even whan 
it is not possible to allow for the effect of systematic errors their 
presence does not introduce maccuracy mto some computatiops 
based upon the scores ha\ung such errors. Averages or measures 
of central tendency are affected by systematic errors, being 
raised or lowered, as the case may be, by the average amdunt 
of the error of the group. In most cases measures of variability 
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{Old of correlation are not affected by such errors. It is more 
accurate to say that they are affected only to the extent that 
the sjrstematic errors are not strictly constant, that is, are not 
of exactly the same magnitude for the whole group m question. 
Variable errors do not usually affect the size of averages, but 
tend to mcrease measures of vanability, and to have a marked 
effect in lowermg measures of correlation. As has already been 
stated in the discussion of atti'iiuation, it is sometimes possible 
to correct for this effect 

Variable errors, which are the errors m question when relia- 
bility and unreliability are being considered, may be either 
sampling or measurement errors and thenffore are those dealt 
with by the various fonnulie givcm m Tables LXII to LXV. 
Since variable errors in most situations approximate a normal 
distribution about zero, this condition has been assumed to 
hold in the derivation of most of the fonnulae given in these 
tables, and unless this condition is fulfilled the formulse are 
not entirely valid. It holds so generally, however, that this 
condition is commonly neglected and the fomiulie employed 
without regard to the fonii of the distribution of errors 

Sampling. As has already been stated, the errors present in 
educational measurement may be divided into errors of sam- 
pling and errors of measurement As their name implies, errors 
of sampling arise from the fact that use* is made of a sample 
or a limited number of cases to represent the whole, or total, 
population or universe, as it is called. They arise from 
both sampling by selectmg mdividuals to represent a larger 
number and samplmg by measuring certain items or traits to 
represent a total abihty or characteristic. It is not alwa}^ 
■necessary, however, to make use of a sample instead of using 
the whole number of mdividuals or measuring the whole ability. 
For example, if one wishes to determine the average score of 
inxfii-grade pupils in a city of ten thousand population upon 

‘ ** For a more complete discussion of systematic and variable errors the 
Mmaa is referred to Walter 8. Monroe, “The Constant and Variable 
IbMM of Educational Measurements,” University of IlUnois fiuZIeltn, 
yol. 21, No 10, Bureau of Educational Reeearch, Bulletin No.,t6 (Ur- 
University of Ulmois, 1923), 30 pp. 
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an arithmetic test it is not a very difficult task to give the test 
to all the sixth-grade pupils in that city, thus having no sam- 
pling at all, insofar as the selection of cases concerned is in- 
volved. But if one wishes to determine the scores of sixth-grade 
pupils in a large city, such as New York or Chicago, or of sixth- 
grade pupils throughout the whole country, it is a formidable, 
and m the latter case practically impossible, undertaking to 
have all of them take the test. Certainly m the case of the 
whole country, and ordinarily in that of a very large city, the 
test will be given to a fairly large number of pupils m the given 
grade selected so as to be as representative as possible of all 
sixth-grade pupils. 

In actual educational practice the condition just described 
often holds. If not impossible it is very difficult to test all 
pupils or secure all measurements of the sort desired, and 
therefore only a selected sample is measured. If this sample 
is truly representative, scores and measures derived from it 
will be the same as they would be if denved from the total 
population from which it is selected. Such a result is never, or 
practically never, obtained. Therefore much use is made of 
errors of sampling in describing the probable accuracy of meas- 
ures obtamed from a portion of a group when compared wdth 
what they would be if secured from the w'hole group. As already 
stated, the reliability of a sample increases as its size increases; 
thus for the sake of accuracy it is desirable to choose as large 
a sample as possible In many practical situations, however, 
the mcreased accuracy secured is not worth the additional 
labor and expensi* involvi'd m increasmg the size of the sample 
beyond a certain point. To decide what this point is one should 
consider the accuracy of the measuring instrument or instru- 
ments to be employed, the use to be made of the obtained 
measures, other possible investments of tune, energy, and 
money, and other similar considerations. 

In selecting a sample, particularly if it is small, one should 
take all possible precautions to avoid bias or errors in choodqg. 
For eiample, if one is selecting twenty sixth-grade rooms to 
be repl^sentativemlall those in a large city the twenty rooms 
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should not be in the same portion of the city, or enroll pupils 
of the same nationality. Instead, the rooms should be selected 
BO that they represent proportionately the various races, types 
of home environment, degrees of social standing, and other 
such factors existing in that city. Similarly, if one is selecting 
a few pupils from each of a number of sixth-grade rooms to 
get a sample to be tested as representative of all the children 
included therein, one should ordinarily not take all the children 
on the front seats or all those on the back seats. It is probable 
that these children are occupying front or back seats, as the 
case may be, because they differ from most sixth-grade pupils 
in some such charactenstic as ability, size, attitude, behavior, 
or personality. Instead, it is better to select the desired propor- 
tion of pupils by some regular plan that avoids any bias. Thus, 
if it is desired to test one-eighth of all the pupils, each eighth 
one alphabetically may be sidected 

When the numbers concerned are large, purely random or 
chance selection usually results in securing a fairly satisfactory 
or representative sample, but it is better not to omit other 
precautions. For example, if it is known that 80 per cent of 
the total population is white and 20 per cent colored, one 
i^ould see to it that a sample mtended to be representative is 
80 per cent white and 20 per cent colored. Likewise, if the 
whole population is 60 per cent from native-born parents and 
40 per cent from foreign-bom parents, the sample should be 
the same. If the whole population has 47 per cent boys and 
53 per cent girls, so should the sample, and so on. 

It is rarely possible to determme whether or not a sample 
is biased or erroneous by a mere study of the sample itself. 
Instead, one must compare it with the total population or with 
another sample selected therefrom. The former method is the 
better, but frequently involves so much labor that the latter 
is preferable. It is commonly assumed that if the composition 
of two samples, each of apparently sufficient size and selected 
irom the whole population in a thoroughly random manner, 
In the same or so nearly the same that the difference is insig- 
nificant with regard to all characteristics likely to affect the 
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thing being measured, either one or both of them is satisfactoiy. 
If the differences between them are sufficiently great to be 
signiffeant they should commonly be combined into a single 
sample and this in turn compared with another sample to see 
if it has been made large enough, or selected in a random enough 
manner, to be representative. In appl 3 nng this method one 
may start with a comparatively small sample and continue 
to select and add to the onginal sample others of the same size 
similarly selected until it has become large enough and repre- 
sentative enough that measures computed from it do not differ 
sigmficantly from those for the last sample selected. Thus, for 
example, one may choose a first sample of one hundred cases 
and then another sample of the same size. If there are serious 
differences between these, they should be combmed into a 
single sample of two hundred cases, and one of another hundred 
selected. If this is still markedly different from the two hundred 
it should be added, making three hundred, and another hundred 
selected, and so on until significant differences disappear. 

In the case of sampling the abilities or characteristics being 
measured it is rarely practicable, even if possible, to secure a 
complete sample of what one desires to measure For example, 
in measuring a pupil’s knowledge of history it is practically 
impossible to use so complete a test as to cover all items that 
he should know. Occasionally, in the case of a very limited 
field, such as the multiplication table up to 12 times 12, it is 
possible to test completely and thus avoid samphng. Although 
errors due to incompleteness of a measunng instrument are 
errors of sampling when considered from the standpoint just 
presented, they may be thought of as errors of measurranent 
when considered as being due to the fact that the measuring 
instrument used is not perfect or complete. Different writers 
and workers in the field, therefore, do not agree in the way 
they classify such errors. Some consider them under one head 
and some under the other. 

A situation in which the usual formulae for errors of sampffi^ 
<b not apply is that involving data from matched grb^, 
that is, groups consisting of equal numbers of indiYhhuUs 
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paired or matched on some basis. Such pairing or matching 
reduces the sizes of the errors of sampling present. The proper 
formulae for such cases have been presented and discussed by 
Wilks,** Lindquist,*' Ezekiel,** and Monroe and Engelhart.*’' 
The most common conditions of matching involve universes 
or total populations of especially selected samples of the same 
number of cases, so chosen as to have the same distribution of 
the variable according to which they are matched, but other- 
wise to be random with respect to the other variable or variables. 
For such conditions the formula is merely that for the ordinary 
standard error multiplied by k or Vl — r^, in which r is the 
coefficient of correlation betweim the two vanables concerned, 
that IS, between the one used as the basis of pairing and the 
one employed as the measure of results. Thus, for example, 
the formula for the standard error of the mean of a matched 


sample is or 


O 

instead of just Perhaps the 


most frequent occasion for the application of thi,s modification 


arises in connection with determining the error of a difference 


between matched groups In this case, lettmg X represent 


“Samuel S Wilks, “The Standard Error of the Means of ‘Matched’ 
Samples,’’ Journal of EducatioruU Psychology, Vol 2‘4 March, 1931, pp. 
305-208. 

, “On the Distributions of Statistics in Samples from a Normal 

Population of Two Variables Kith Matched Sampling of One Vanable,’’ 
Metron, Vol. 9, March, 1932, pp 87-120 

“ E F. Lindquist, “The Significance of a Difference between ‘Matched’ 
Groups,” Jarmrnal of Educatumal Psychology, t'ol 22, March, 1931, pp. 
197-204. 

, “A Further Note on the Significance of a Difference betwerai 

the Means of Matched Groups,” Journal of Educaltonal Psychology, VoL 
24, January, 1933, pp. 6fr-69 

“ Mordecai Ezekiel, “Student’s Method for Measuring the Sigmficanoe 
of a Difference between Matched Groups,” Journal of Educatumal Psy~ 
tJulogy, Vol 23, Sept^ber, 1932, pp 446-4.W 

, “Reply to Doctor Lindquist’s 'Further Note' on Matched 

0roup6,” Journal of Educational Psychology Vol. 24, April, 1933, pp. 306- 

tOd. 


P'SIK S. Monroe and M D Engelhart, “A Cntical Summary of Re- 
■trah Bdating to the Teaching of Anthmetic,” University of lUinou 
mB'ltf ii, VoL 29, No. 6, Bureau of Educational Research, Bulletin Nb. f8 
UlflbaBa, Univei^ty of Ulmois, 1931), pp. 100-106. 
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tile variable used in matching and Y, the one employed to 
measure results, the formula for the difference between means 
is 

if the differences are correlated and the same with the last 
term omitted, that is, 

V(1 - 

if they are not, which is usually the case. 

The formulffi just given assume that the correlation between 
the two variables is the same m the two groups being dealt 
with. If It is not, the following, respectively, should be em- 
ployed : 

>/(! ~ + (1 - - '■*,», and 

>/(! - (1 ~ 

If, as is more rarely true, the matched groups are selected 
from universes or whole populations of individual differences 
by matching each case in one group with a case m the other, 
the standard error of the mean difference is 


- Vi 


It is merely the standard deviation of the differences divided 
by the square root of one less than the number of oases. 

Peters and Van V<xjrhis have shown that whenever the 
number of cases in the total population from which a 
sample has been selected is knonm .the formula for the 
standard error of the mean should be multiphed by the factor 



n — 1 
N -l’ 


in which n is the number of cases in the samp^B 


“Charles C Peters and W R. Van Voorhis, “A New Proof AnS Oor- 
reoted Formulas for the Standard Error of a Mean and of a Bbtiwhud. 
DeVtation," Journal of Educaitonal PtychcAogy, Vol. 24, NovaiBber, 
pp 620-633. 
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and N the number in the total population. They suggest that 
the expression be simplified by neglecting the I's in both numer- 
ator and denominator as being too small compared with n and 
N to change their values significantly and using p, from per 


n 


cent, for which gives Vl — p- Inspection of this formula 

makes it evident that the larger the sample in proportion to 
the total jiopulation which it represents, the smaller the error 
of sampling. For example, if 100 cast's are chosen from 5000, 
the formula gives approximately 99, if 100 from 1000, approxi- 
mately .95, if 100 from 500, approximately .89, and so on 
until if 100 from only 100, it gives 00 or no error of sampling, 
as is evidently the case The two writers mentioned also show 
that the same formula applies to the error of the standard 
deviation. Likewise it seems vahd in all instances in which 
the error formulae as given in the tables near the beginning of 
Ais chapter are composed of the error formula for the mean, 

ff 

multiplied by some constant. Furthermore Peters and 


Van Voorhis show that for errors from true scores in cases of 
correlated or matched samples the p employed in the formula 
becomes equivalent to r, and thus derive the multiplier Vl — r 
fw such cases. 

The interpretation of errors. Probably the most important 
point to be remembered in the interpretation of errors is that 
they do not apply to particular cases but to distributions of 
cases. That is,' we are generally unable to determine the error 
present in any one score or measure, but we can descnbe by the 
use of the formula given in Tables LXII to LXV the numbers 
and sizes of the errors present m a whole distribution of meas- 
ures. For example, if a roomful of children takes a certain test 
for which we have the necessary data available we can deter- 
mine approximately how many of the pupils’ scores contain no 
errors at all, how many are one point in error, how many are 
jbfpp points, and so on; but we cannot throw any light upon the 
li^mtion of how large is the error in the score of any individual 
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The description of the numbers and sizes of errors affecting 
a particular group depends upon the interpretation of the 
measure of error used Ordinarily the standard or probable 
error is used and may be interpreted in the same way as the 
standard or median deviation when used to measure ordinary 
variability. It will be recalled that a distance of one standard 
deviation in one direction from the mean mcludes 34.13 per 
cent of the cases in a normal distribution, and, consequently 
that a distance of one standard deviation m both directions 
includes twice this many, or 68 27 per cent, of the cases. Smce 
the standard error is merely the standard deviation of the 
errors, it includes the same per cent of the errors. 

From the previous discussion it is apparent that if the stand- 
ard error of a certain measure is given as three pomts, for 
example, it means that the chances are 68 27 out of 100 that 
this measure is not in error by more than three pomts. Stating 
it otherwise, the chances are 68 27 to 31.73 (this is the difference 
between 100 and 68 27), or about 2.15 to 1, that the error is 
not greater than three pomts. Since it is known not only that 
a certam per cent of cases may be found withm one standard 
deviation from the mean, but also what per cent may be found 
within any given distance from the mean, the chances of there 
being an error of any given size can be detennmed. If in the 
cases just cited, when the standard deviation is three, one 
wishes to know the chance of an error greater than six, that 
is, greater than two standard errors, all that he need do is 
compare the per cent of cases m a normal distribution more 
than 2<r from the mean, with the per cent less than that dis- 
tance from it. Since this distance includes 95.45 per cent of 
the cases, there remain 4 55 per cent that are probably greater 
than six points, or 2a Therefore the chances are 95.45 to 4.65, 
or about 21 to 1, that a particular measure is in error by less 
than six points; or, reversing the situation, only about 1 to 21 
that it is in error by more than six points. 

The same method of mterpreting errors as has just been 
described for the standard error may be used for the probable 
4firror and any others employed. The difference consists merely 
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in the fact, already set forth in the discussion of variability, 
that the various measures of errors are of different sizes, and 
thus their numerical significance differs. Since the probable 
error is the median deviation of the errors, that is, the distance 
that includes just half of the cases in the normal distribution 
when taken on both sides of the mean, the chances are 50 to 
50, or 1 to 1, that a particular measure is not m error by more 
than the probable error. Furthermore, smce a distance of two 

TABLE LXVl 

Per Cents or Errors Not Greater Than Certain Standard 
AND Probable Error.s and Corresponding Chances That 
THE Error in a PARTirCLAR Measure Ls Le.ss Than 
THE Given Error 


PaKT a — SlASDAnO Khhoha 
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probable errors on each side of the mean includes 82.27 per 
cent of the cases, the probabihty that a given measure does not 
contain an error greater than 2PE is 82.27 to 17.73, or about 
4.6 to 1. 

To assist the reader in mterpreting the sigmficance of errors. 
Table LXVI has been prepared. It contains certam entries 
taken from the tables in Appendix B and gives the per cents 
of all cases in a distribution included by certain standard and 
probable errors and the correspondmg chances that the error 
in a particular measure is less than the given error. 

The first line of this table, for example, shows that within a 
distance of So- from the mean there are included 38 29 per cent 
of the cases and that the chances are .62 to 1. that the error m 
any single measure is less than .5o- Thus, if in a given situation 
a has been found to be five pomts, it is known that shghtly 
more than 38 per cent of all the errors are less than half of 5, 
or 2.5; in other words, the chances are 62 to 1. that any 
particular error is less than 2.5. If it is desired to reverse this, 
it 18 apparent that the per cent of errors greater than 2.5 is 
100.00 — 38 29, or 61 71 per cent, and that the chance that any 
particular error is greater than 2.5 is about 1.6 to 1. This 
interpretation may be extended by employmg the other lines 
of the table. Thus there are 2 15 chances to 1 that any par- 
ticular error is not greater than the standard error, or 5; 6.5 
chances to 1 that it is not greater than 7 5 ; and so on. 

The same type of interpretation apphes to the probable error 
also. Thus if m a given situation it is 2, it is known that about 
26 per cent of the errors are less than half of 2, or 1; that 50 
per cent of them are less than 2; that almost 69 per cent are 
less than 3, about 82 per cent less than 4; and so on. Or, ex- 
pressing it otherwise, the chance that a particular error is less 
than 1 is about .36 to 1 ; that it is less than 2 is 1 to 1 or even; 
that it IS less than 3 is 2.2 to 1 , and so on. 

In the interpretation of errors, one should remember that 
they are assumed to be distances from the true measure in 
question. The figures given in Table LXVI, for example, are 
based upon the use of the true measure, which of course has 
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an error of zero, as the mean or central point of the distribu- 
tion from which errors or distances are measured. It is not, 
therefore, theoretically justifiable to take an actually obtained 
measure as the central pomt from which to measure errors. 
The correct interpretation is, therefore, that the chances deter- 
mined are those that actually obtamed measures are within 
the given amounts of true measures To take a concrete exam- 
ple, if a mean of 85 has been obtami'd and its probable error is 
2, the proper interpretation is that the chances are even that 
this actually obtamed mean, 85, is within two points of the 
true mean, and not that if a large number of sunilar means 
from similar sets of data are computed, half of them will be 
within two pomts of 85 and half not withm two points thereof. 

Another point that arises in the interpretation of errors con- 
cerns the coefficient of correlation more than any other com- 
monly employed measure. It is that because the coefficient of 
correlation has 1,00 as its limiting value, the normal curve 
representmg the distnbution of errors is arbitrarily cut off, 
and thus some of the theoretically possible errors cannot occur. 
In most situations this limiting effect is so slight as to be negli- 
gible, but occasionally, especially when the number of cases 
from which the coefficient is computed is quite small, it is real. 
For example, if a coefficient of correlation of .90 has been ob- 
tained from only eighteen cast's, its probable error is 

1 _ 002 

.6745- — ~ = .032. 

V18 - 2 

If .90 is taken as the true coefficient of correlation the distance 
from the true coefficient to the greatest possible value 1.00 is 
.10 or 3.1PE. ^Wsoordmg to the table given in the appiendix, 
about 2 per cent of the area of a curve lies beyond that distance 
from the mean in one direction. In this case, obviously no co- 
ifficients can be obtamed greater than 1 .00. Since this is a fairly 
wetreme case and the per cent of area or possible error n^lected 
is so small, the truth of the statement made above, that in most 
Hiasas this limitation upon interpretation is negligible, ie evident. 

To save space it has become the convention^ practice to 
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write the probable error of a measure immediately after it with 
the plus or minus sign connecting the two. Thus, instead of 
writing out in full that the probable error of the mean, 85, is 2, 
one commonly writes merely M = 85 ± 2. No similar prac- 
tice in the case of the standard error has been adopted, so that 
if a mean is 85 and its standard error is 3, it should be expressed 
as follows; M ~ 85, (Tm = 3. 

It is good statistical procedure to give the errors, usually in 
the form of the PE, of all expressions susceptible to them used. 
In common practice this is not often done, however. The errors 
are most frequently given in connection with coefficients and 
ratios of correlation. In the case of tables containing a number 
of similar measures based on the same, or almost the same, num- 
ber of cases it is often convenient to descnbe the sisse of the 
errors in a single summary statement instead of giving each 
separately. Such a statement is usually given as a footnote 
and might read as follows in a particular case: “The probable 
errors of the coefficients between .87 and .92 are .02; of those 
between 81 and .86 are .03; between .75 and .80, .04; between 
.68 and .74, 05.” 

Various uses of measures of error. The measures of error, 
especially the standard and probable errors, have several more- 
or-less distmct uses or meamngs which it is helpful to keep in 
mind. Some of these have already been mentioned, but it seems 
well to list them together.** They are as follows: 

1. A measure of the rehabihty of sampling. This use has already 

been discussed 

2. A measure of the reliability or accuracy of any one of a number of 

scores or measures of the same individual. This also has been 
referred to earlier m the chapter. 

3. A measure of the reliability of a measuring instrument. This may 

be divided into two subheads, both of which are discussed in 
the next chapter. These subheads are as foUoWs: 

"A more complete discussion of these uses and also of certain othea. 
phnnm of the standard and probable errors may be found m Charles W. Odell, 
“The Interpretation of the Probable Error and the Coefficient of Cor- 
relation,” Universtly of ISinou BoiUtva, Vol. 23, No 52, Buream of Educa- 
hmial Research, BuUctm No 32 (Urbana, University of TUisbis, 192C), 
Ch. 11. 
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a. A measure of the reliability or accuracy of scores obtained 

from the measuring instrument when compared with scores 
obtained from another application of the same instrument 
or from the application of a supposedly equivalent measur- 
ing instrument to the same individuals. Such errors are a 
variety of errors of estimate. 

b. A measure of the reliability or accuracy of scores obtained 

from a measuring mstruraent when compared with the 
theoretically true scores. Such errors are called errors of 
measurement. 

4. A unit of measurement Although the measures used for this 
purpose are in reality the standard and median deviations 
rather than the standard and probable errors, this use is men- 
tioned here because it is common practice to spieak of the prob- 
able error, especially in its abbreviated form, PE, as the unit. 
Such a unit is used in order to provide one that is common for 
all scores and measures It has been most frequently employed 
in the determination and expression of the values or difficulties 
of the various elements in a scaled test, that is, one in which the 
elements increa.se in difficulty Similarly, it has been used as a 
measure of the merit or quality of the specimens in scales, such 
as are commonly used to measure handwriting, drawing, or 
English composition, composed of a number of specimens of 
the thing to be measured arranged m order of increasing merit. 
A further discussion of its use in this connection will be found 
beginning on page 390. 

Differences. The significance of differences between two or 
occasionally more measures of the same thing is frequently 
important. It arises in connection with such questions as 
whether or not one group of pupils is really supenor to another 
group, whether a single pupil or a group shows improvement 
from one time to another, whether per capita costs in one sys- 
tem are significantly greater than those in another, and many 
o&er similar questions. Sometimes it is desirable not merely 
to determine the significance of differences, but also to deter- 
ruune that of differences of differences. Perhaps the most com- 
mon example of this arises in connection with educational ex- 
poiments in which the gains made by two groups of pupils 
lave been compared. The differences or gains between the first 
and second scores of each group may be called the first differ- 
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enoes, and the difference between the gain of one group and 
that of the other, the second difference. For such a atuation 
as this a somewhat more complicated formula is required than 
when merely similar differences are to be interpreted. Fur- 
thermore, in connection with the interpretation of differences, 
there has been considerable argument and also considerable 
erroneous practice as to the formula to be used. 

The seventh formula given in Table LXV, that is, 

o'difl = Vcrl + (tI 

is the basic formula for standard errors of sums or differences. 
When differences an- concerned, the sign of the third term is 
always — . In some cases m which differences are dealt with, 
the coefficient of correlation is difficult, if not impossible, to 
compute. In every cast* doing so adds considerable labor 
to the work invoh’ed. Therefore since, if the value of the 
coefficient of correlation is zero, the value of the whole third 
term becomes zero, the formula is commonly given and em- 
ployed in the shortened form y/a\ -h ffj, which is vahd only 
when no correlation e.\.ists. It is difficult, without actually 
computmg the correlation, to determine when one is justified 
in using the short form of the formula. As has been pointed 
out by several writers, “ it has frequently been employed when 
there is no justification for its use and when it can be shown 
that there is a definite relationship between the two variables 
involved. Therefore the wnter recommends very strongly that 
unless it is quite clear that the relationship between the two 
variables is purely random, so that the correlation must be aero, 
the long form of the fonnula be employed. To illustrate, if 
the average height of a group of fourth-grade pupils in one sys- 
tem is compared with that of fourth-grade pupils in another it 

* Of the referenoee dealing with the two formula for erre^ or difforenoea ' 
tite following are among the best Helen M WaLker, “Conc«nung thf 
Standard Error of a Dig'erence,” Jottmal of Educatvonal Psychology, Vol. 
20, January, 1929, pp. 53-60. E F Lindquist and R R. Foster, "On the 
Determination of Rdiability in Comparing the Final Mean-Si&ores 'bf 
Matched Groups," Jowrud of Educatvmcd Psychology, Vol. 20, FebmiH7» 
1989, pp. 102-106. 
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is evident that there ia no correlation between the heights of 
the individuals m one group and of those in the other, so that 
the use of the short formula is justified. In general the same 
situation exists whenever the differences dealt with are between 
two separate and unconnected groups of individuals. If the 
mean height of a group of fourth-grade children in one system 
is compared with the mean height of the same children a year 
later, the complete formula should be used since it is evident 
that there are common factors influencing the heights at the 
two times of measurement. This situation usually prevails 
whenever the data dealt with are two senes of measures of the 
same individuals. 

To return to the other question mentioned above, that of 
dealing with differences of differences, all that is necessary is 
to substitute m the formula as given m Table LXV the errors 
of the differences instead of those of the measures themselves. 
This has been shown m more detail by Monroe and Engel- 
hart.“ The complete formula for the standard error of a differ* 
ence between differences is 

Vffl, + <rl, -1- ffj, + <r*, - - 2r,,„(7x,o-„,. 

The formula may be written 

The correlation between the differences of pairs of measures is 
evidently zero because these differences are obtamed from dif- 
ferent groups, and thus no correlation is possible. 

The apphcation of this formula may be illustrated by suppos- 
ing a situation in which one is comparing the gains made by 
two classes, each of forty pupils. Let us suppose for one group 
the mean score on the first test is 82, and that on the second 
test 85; that the standard deviation of scores on the first test 
le 0, and on the second test 10; and that the correlation between 

** Walter S. MonrOe and Max O. Engelhart, "Experimental Researeli 

^ Education,” Umvermly of JUtrum BuUetin, Vol. 27, No. 32, Bureau til 
uoational Reaeareh, Bulletin No. 48 (Urbana, Umvcosity of lUinolB, 
ISaO), Ch. iU. 
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the two series of scores is .70. For the second group let us sup- 
pose that the corresponding figures are 84, 88, 8, 7, and 
The question to be answered is whether the mean gain of four 
points made by the second group is significantly greater than 
that of three pomts made by the first group. 

For the first group the standard error of the first mean is 


0 10 

= 1.42, and that of the second, = 1.58. For the 

8 

second the standard error of the first mean is = 1-26, and 


that of the second, —7= = 1.11. Substitutmg the proper quan- 
v 4U 

titles m the formula just given, we have 


Vl i2« + 1 68' + 1 26* + 1 U> - 2 X 70 X 1 42 X 1 58 - 2 X .80 X 1.2a X 1 11 


whence the standard error of the difference of the gains is found 
to be 1.40. This, of course, may be obtained also by actually 
computing the standard error of the difference or gam m each 
case, and then substituting these two standard errors of the 
gains, 1.17 and .76, in the short formula for the standard error 
of the difference. Evidently a difference of 1 00 which has a 
standard error of 1.40, is not of much sigmficance. 

It sometimes happens that the differences with which one 
wishes to deal are those between similar forms of the same test 
or other measuring instrument. In case this is true the standard 
deviations of the scores on the two forms are* frequently nearly 
enough the same that they may be so considered. Thus the 
formula for the standard error of a difference becomes 
(Tdiir = V'2<r* — 2r(r* = (7\/2Vl — r if there is correlation, and 
\/2a* or ay/2 if there is none. Since ay/l — r is the standard 
error of measurement, we have from the first formula just 
given, ffdifl = y/2<r^. 

Dunlap ** has pointed out that if the differences dealt witit 
involve true instead of actual scores, their errors may be found 
by the substitution of the standard enior of a true measure for 

"Jack W. Dunlap, "Falhble Scores and the Standard Error of a 1M-* 
ferenoe,” AnMrtcm Journal of Prychology, Vol. 44, July, 1932, pp, 381"* 
582. 
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that of an actual measure in the formula. Aa was stated in the 
discussion of the standard deviation, o. or Ctrue “ ®’obt'\/r, T 
being the coefficient of reliability. Hence if the error of a desired 
difference involves one senes of true scores and one of actual 
scores the proper formula is ad,n — Vrntrf + ol — 2ri*<ricri if 
there is correlation present, and Odiff = VrnoJ + tr| if there 
is not. In these two formulae the vanable referred to by the 
subscript 1 is that for which the true scores are involved. If 
both senes are of true scores, the corresponding formulae are 
VruffJ + rmcl — 2ri2(ri<j-2 and \/ ruff? + r2iiff?. 

As several writers “ have shown, it sometunes happens that 
it is convenient to be able to detonnme the reliability of a dif- 
ference between the scores of a supposedly random group upon 
which the norms for a test have been established and a later 
series of scores of the same group, both senes of scores being 
expressed in terms of standard measures. Such an occasion 
arises so rarely m actual practice that the proper formula will 
not be presented here The writer who is mterested will find it 
in the second of the tw'o references given below. 

In connection with the interpretation of differences, Lin- 
coln has well pointed out that differences statistically sig- 
nificant according to the conventional methods of interpretar 
tion may appear to be much less so when viewed from another 
point of view, that of the overlapping of the total distributions 
concerned. The difference between two means, for example, 
may have several chances to one in favor of its sigmficance, 
but the overlapping on one distribution past the mean of the 
other may be one-third or one-fourth of the whole. Before 
reaching a final conclusion as to sigmficance, therefore, it is 
well to determine the overlapping, according to the method 
described in Chapter XXII or a similar one. 

“ Helen G. Pratt, Jack \V. Dunlap, and Edward E Curcton, “The 
^bject-Matter Progress of Three Activity 'fSebools in Hawaii, with a 
Note on Statistical Techniquei” Journal of Educaiional Paycholoffy, Vol. 
aOjOctober, 1929, pp. 494-500, 

Earl 3 Holzinger, “The Probable firror of a Differenoe Formula,” 
Xaumal of Edvcational Paychnloffy, Vol. 21, January, 1930, pp. 63-64. 

' ’’***E<bmrd A. Lineoln, “The Insignificance of Significant Differenoea,” 
li^Wfinal of ExperimmUd Edwatvm, Vol. 2, March, 1934, pp^ ^8^290. 
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The esperimental-coeffident method. In addition to the one 
already described there is another means of interpreting meas- 
ures in comparison with their standard or probable errors. This 
is known as the experimental coefficient method. The experir 
mental coefficient was suggested by McCall for use in de- 
termining the significance of a difference between two measures, 
and is commonly employed for this purpose only, but the method 
may be applied to the interpretation of any measure in com- 
parison with its standard or probable error. McCall suggested 

that the experimental coefficient equal The multi- 

plier in the denominator, 2.78 (more exactly, 2 7818+ ), was 
chosen so that when the value of the fraction equals one the 
chances of a difference being significant are great enough that 
they can be considert'd practical certainty The ratio chosen 
by McCall for practical certainty was 369 to 1. 

The experimental coefficient is usually interpreted by means 
of a table such as Table LXVII. 

T\BLE LXVII 


Chances That a Difference Is Significant Corrbspondino to 
Various VALUEh of the Experimental Coefficient 


Erpertmenlal Coefficient 

Api/rorimate Chances 

.1 

1 6 to 1 

.2 

25 to 1 

.3 

3 9 to 1 

.4 

6 5 to 1 

.6 

11 to 1 

.6 

20 to 1 

.7 

38 to 1 

.8 

76 to 1 

.9 

162 to 1 

1 0 

369 to 1 

1.1 

900 to 1 

1.2 

2,370 to 1 

1.3 

6,700 to 1 

1.4 

20,300 to 1 

1 5 

67,000 to 1 


“ William A. McCall, Hme to Measure in Eduealton (New York, Mao- 
nullan Co., 1922), pp. 404-405; How to Sxperimmi in Education (Ne# 
Ytak, Mao 0 itlla& Co., 1923), pp. 154-lSS. 
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From this table it may be seen that if the experimental ooeffi- 
cient is .1, for example, the chance that the difference is signifi- 
cant is only 1.6 to 1, that if it is .2 the chance is 2.5 to 1, and 
so on. 

To illustrate the application of the experimental coeffidept 
we may use the already employed example of a class of forty 
pupils with a mean score of 82 on one test and of 85 on another. 
If the tests are of equal difficulty and cover the same material, 
the question arises whether the gam of three points is signifi- 
cant or not. It has already been mentioned that the standard 
error of the difference is 1 17; therefore the experimental co- 


efficient = 


2.78 X 1 17 


= 92. 


The chance that the difference 


is significant is somewhat greater than 162 to 1, amounting to 
about 187 to 1. 

Although McCall stated the expenmentaj coefficient formula 
only in terms of standard error, it may also readily be stated 
in terms of the probable error. All that is necessary to do 
this is to divide the factor 2.78 by .6745 and substitute the 
result for it. This gives the expenmental coefficient equal to 
Difference 
4.12P£dui' 

To make clear what the experimental-coefficient method 
really is, how it is related to the interpretation of the standard 
and probable errors previously given, and how it may be ap* 
phed to other cases than differences, its derivation will be shown. 
It will be recalled that the mterpretation of the standard and 
probable errors is based upon the fact that these errors are 
merely the standard and median deviations, respectively, of the 
distribution of errors, and that by comparing the area of a 
normal curve included within the given distance of the mpAn 
with that outside of that distance the chances that an error is 
less or greater than the given amount can be determined. In 
the case just used as an example of the experimental coefficient, 
the standard error of the difference was found to be 1.17. There- 
fore, if tests of equal difficulty are given to the same pupils 
Bader the same conditions a large number of times, the ehannua 
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Are 2.15 to 1 that the difference between the actual mean of one 
test and the true mean will not exceed 1.17. For a difference of 
three, which equals about 2.56am, the chances are about 93 to 1 
against its occurrence. This of course is derived from the fact 
that the area withm a distance of 2.56a of the mean of a normal 
curve is about 93 times as great as the area outside that dis- 
tance from the mean.*' This fact may be illustrated by Fig- 
ure 40. In this figure ordmates have been erected m both di- 



FIQ 40 NORMAL CURVE ILLUSTRATING DIFFERENCE BETWEEN 
ORDINARY METHOD AND EXPERIMENTAL COEFFICIENT 
OR CRITICAL RATIO METHOD OF STATING RELIABILITY 

The chances by the ordinary method are the ratio of 4947 to 0053 or 93 to 1, 
whereaa those by the experimental coefficient method are the ratio of .9947, 
that u, .4947 + .4947 + 0053 or 187 to 1 

rections at a distance of 2 56<r from the mean. These ordinates 
represent a mean three points or 2.56<r distant from the true 
mean. As was just stated, the area between these two ordinates 
is approximately 93 times that outside them. 

The experimental-coefficient method deals with the same 
facts in a somewhat different way. Instead of answering the 
question “What are the chances of a certain difference?” (in 
this case three) it answers the question, “If the difference is a 
certain amount (in this case three), what are the chances that 
” The result given above was secured as follows* the a table in Appendix 
B shows that the area under the normal curve at a distance of 2.50* from 
the mean is .4938, and that at a distance of 2 6 from the mean is .495A. 
The difference is 0015. To secute the area within a distance of 2.66ff of 
the mean, 6 of this difference, which equals .0009, is added to .4988, giving 
.4947. Subtracting this from .5000 gives .0053 and dividing this into .4947 
gives approximately 93. 
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the larger mean really should be larger than the waller oim?" 
Therefore, instead of oompuing the area outside of the given 
distance with that within it, it compares the area beyond the 
given distance in only one direction with all of the remaining 
area under the curve. If this is done in the case just given, the 
portion of the area beyond the ordinate at one end of the curve 

is found to be about of that of the remainder of the curve.” 

In other words, the chances are approximately 187 to 1 that the 
actual mean of 85 represents a true mean that is larger than the 
true mean represented by the actual mean of 82. Another way 
of stating the same thing is that there are 187 chances to 1 
that the true difference is in the same direction, or has the same 
sign, as the actually obtained difference. It will be noticed that 
187 = 2 X 93 + 1. As may readily be shown, this relation- 
ship always holds. If the area of the two larger portions of the 
area under the curve is 93 times that of the two smaller or ex- 
treme parts, it is twice that much, or 186, times the area of one 
of the extreme portions. Therefore the total area m both large 
portions plus one of the small ones is equal to 1 + 186, or 187, 
times the area in the other small part. In other words, the 
chances as given by McCall m connection with his expenmentaJ 
coefficient are equal to one more than twice the correspondmg 
chances as given in Table LXVI. 

The usual application of the experimental-coefficient method 
when differences are not concerned is to the coefficient of correla- 
tion. It IS most often applied thereto by considenng that the 
question involved is the difference between the obtained coeffi- 
cient and zero. For example, if a coefficient of correlation of 
.24 has been obtained, the difference between this and .00 is of 

, 1* The ratio given above, 187 to 1, is obtained by dividing the area in 
'■tfce larger of the two portions into which the total area under the curve is 
litvided by the perpendicular at a distance of 2 56a from the mean, by that 
iii the silver portion. The former is approximately .0947 of the total 
area and the latter .0053, and the quotient of the second mto the first is 
187 . This method of obtaining the chances of significance yields the same 

r its as McCall’s and is generally easier to ap^y. The tables in App^p- 
B give ratios obtained by this method. 
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course .24. Therefore if this is divided by 2.7&(r^ tiie rrault 
gives the chances that the true coefficient is really greater Idum 
sero, or that some positive correlation exists. 

It may be, however, that the question is not whether there is 
some positive correlation or, in other words, whether the true 
coefficient is greater than zero or not, but rather whether the 
correlation is greater than some given amount, such as .20. 
The procedure in such a case is merely to take the difference 
between the actually obtained coefficient of correlation and the 
one set as the critical pomt. In this case doing so gives .04 and 
dividing this by 2.78(r<i,fT gives the chances that the true coeffi' 
cient is really greater than .20. In dealing with numbers of co- 
efficients of correlation or other measures where a certain degree 
of reliability is desired it is frequently convenient to reverse 
the process and determine for an actually obtained measure 
the corresponding value of the measure above which the chances 
are a desired ratio that the true value of the measure really bes. 
For example, a table may be constructed to show for any given 
obtained coefficient of correlation and number of cases the co- 
efficient above which the chances are 10 to 1, 20 to 1, or any 
other desired ratio, that the true coefficient really lies. After 
such tables have been constructed it is not difficult to go one 
step further and construct graphs from which the desired value 
can be read by inspection For an illustration of such a set of 
graphs the reader is referred to Ezekiel,® whose work is based on 
that of Fisher.** An article by Edwards may also be found 
helpful in this connection. 

The question has probably arisen in the reader’s mind as to 
which one of these two general methods of interpretation of 
mestsures and their errors is to be preferred. In general the 

** Mordecai Met-hoiU of CorreUitt4m Analysis (New Yewk, JoW 

Wiley & Sons, 1930), Appendix 3, "Graphic Charts for Interpreting’’^ 
Adjusting Correlation Constants ’’ 't 

** R. A. Fisher, Stahtiical Methods for Research Workers (Edinburg 
Oliver and Boyd, 192S), pp 159-171 

*° K. H. R. Edwards, "Note on the Significance of CoirelatiQa Coeffi- 
cients from different Samples,” Journal of Applied Ptychototy, VoL 18, 
August, 1934, pp. 623-535. 
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writer reoommendB that the first or ordinary method be used 
in cases where differences are not concerned, but that the 
experimental-coefficient method be used in connection with 
differences. The reason for this is merely that in interpreting 
a difference the chief interest is usually in whether or not there 
is actually a difference in the direction indicated, that is, whether 
or not one measure is really larger than another, whereas in 
most other cases the chief interest is in how near the obtained 
measure is to the true measure. 

The critical-ratio method. The cntical-ratio method is 
similar to that of the experimental coefficient, but differs in 
detail. As defined by McGaughy,*' the critical ratio equals 
the difference between two means divided by its probable 
error. Those employing it have sometimes extended its use 
to other measures than means It differs from the experimental 
coefficient in the use of the probable instead of the standard 
error and in the omission of the multiplier in the denominator. 
The chances corresponding to its various values may be deter- 
mined by dmdmg .5 plus the per cent of the area under a nor- 
mal curve included within the given PE distance of the mean 
by .6 minus the same per cent of area. For example, m the case 
already employed in which the difference of the means is 3 

and the is 1-17, PFd.fl = -6745 X 1.17 = 79 and ^ = 

3.80. The area within 3.80PF on one side of the mean is .4948 
of the total area. Hence the chances that the difference is sig- 
5 -f- 4948 

nificant are ^ or about 191 to 1. This differs from 

the ratio of 187 to 1 already found only because of dropping 
decimals. 

Hie varia]ice method. The use of the variance method, 
i^ch is based largely upon the variance or square of the stand- 
luid deviation, has been unusual in the field of educational 
atetistics, and therefore will not be explained here. The reader 

** J. R. McGaughy, The Fiscal Administration of City School SyUems, 
V of the Publications of the Educational Knanoe Inquiry (New 
Ytioli, MaenuUan Co., 1924;, pp. 9, 71-74. 
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who is interested therein is referred to a treatment of the sub- 
ject by Snedecor.*® 

Statistical versus social significance. The discussion of ro- 
liability or significance m this chapter has been from the statist 
tical standpoint. There is, however, another standpoint that 
should be suggested here although no detailed discussion thereof 
will be given. This is that of social significance or importance, 
as Tyler and others have called it. This usually arises when 
the significance of a difference is being considered and refers 
to whether or not the indicated difference is valuable enough 
to society to be worth obtainmg, whatever it may cost. For 
example, a controlled experiment may show significant differ- 
ences in pupil leammg when different methods of teaching are 
used, when class sizes differ, when a better teacher is secured 
for one class than for the other, or under other variations in 
conditions. The question that must be answered before a deci- 
sion can be reached as to which method, class size, or teacher 
salary is preferable is that of the worth and cost of the differ- 
ences. For example, if it is found that pupils’ learning is 10 
per cent better under teachers who can be secured at 25 per cent 
higher salaries, is this worth-while or is it not? The answers 
to such questions cannot be arrived at statistically, but depend 
upon considerations that are largely philosophic m their nature. 
In any given case there will probably be a pomt of diminishing 
returns beyond which it is not worth-while to go even though 
statistically significant differences can still be obtained. 

The opposite condition sometimes, though less frequently, 
holds. Some results am so important socially that if there is 
even some probabihty that they can be obtained more largely 
in one way than another, even though the improvement is not 
definitely significant statistically, it is worth-while to pay the 
cost. In some cases the failure to obtain statistically significant 
differences is due, not to the fact that they really do not erist, 

George W. Snedecor, CtUadalion and Inter preialton of AndtffU* of 
Vanance and Covariance (Ames, Collegiate Press, Inc , 1934), 96 pp. 

** Ralph W Tyler, ‘‘What Is Statistical Significance?” EduadioWiI^ 
RtMoTch BuUettn (Ohio State Umversity), Vol. 10, March 4, 1931, pp. 116- 
116, 142 
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but to the use of measuring instruments that are too coarse, 
that is, measure too large units, to be accurate. For example, 
if one measures a child’s gain in weight by the use of scales that 
do not measure accurately in smaller units than 5 pounds, the 
result is that real and significant gains during a period of weeks 
or even of months do not appear so by statistical methods. 
Similarly, many of the tests and other mstruments used to 
measure the achievements of pupils are not so fine and accurate 
as to be satisfactoiy for measuring gains made from day to 
day, week to week, or even from month to month. 

Exercises 

No specific exercises are given here It is suggested, however, that 
students compute the standard and probable errors of the various 
measures call^ for in the exercises at the ends of previous and later 
diapters insofar as the formulae apply to them. 



CHAPTER XX 

ERRORS OF ESTIMATE AND OF MEASUREMENT 

Introduction. This chapter is concerned with errors, other 
than those that arise from sampling a total population, involved 
in the use of measures of correlation and of regression. Such 
errors may be divided into two types: errors of estimate and 
errors of measurement, using the latter term in a more restricted 
sense than that in which it was employed m the previous chap- 
ter. Smce errors of measurement are a variety of those of esti- 
mate and the dividmg line between the two is not always dis- 
tinct, some workers in this field doubt the advisability of using 
the two terms. To the writer it seems best to do so. 

Errors of estimate. Errors of estimate are differences between 
actual scores and estunat(‘d or predicted ones, the predictions 
being based on some form of the regression equation, usually the 
ordinary one given on page 241. For example, if scores on one 
duplicate form of a test are estimated from those on another, 
or if school marks are predicted from scores on a prognostic 
test, the differences between the estimates or predictions and 
the scores or marks actually made are errors of estimate. Errors 
of measurement, however, using the term m its narrower sense, 
are the differences between actually obtamed scores and true 
scores, that is, scores that contain no errors due to the use of 
imperfect measuring mstruments. Sometimes differences be- 
tween two sets of actual scores may be considered errors of 
estimate. 

Since errors of estimate are the differences between two 
series of scores, both of which are subject to errors, they aWf 
larger than errors of measurement; which are the differences 
between one series of actual scores, subject to errors and one 
of true scores not subject thereto..!^ Moreover, the different 
series of scores wdth which errors estimate are associated 
nuy or may not be measures of the Came thing, whereas those 
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with which errors of measurement are connected must be 
measures of the same trait or characteristic. Another way of 
stating the same thing is that errors of estimate are variable 
errors of validity, which includes reliability, whereas errors of 
measurement are variable errors of reliability alone and conse- 
quently are smaller than those of vabdity. 

The general formula for the standard error of estimate is 
ffi.j or ffest, = ffiVl — or oykn. The subscript before the 
point and the standard deviation on the nght side of the equa- 
tion are those of the variable bemg estimated. For example, 
if X is bemg estimated m terms of F, the formula is <r».„ or 
= triVl — r?„. Thus, if the standard deviation of X is 
6 and the coefficient of correlation between X and Y is .70, 
the standard error of estimate of X is 6\/l — .70* = 4.28. 

There are several variations of the standard error of esti- 
mate for which the appropriate formulae should be employed 
when they occur.* One of these is the standard error of an 
actual criterion measure or independent criterion, that is, some- 
thing used as a basis of comparison to determine the validity 
of measures, estimated from an actual measure or score. It 
differs from the general formula only in subsenpts and is 
ffo-i or o-art, = ffoVl — loii which the subsenpt 0 refers to 
the critenon measure and 1 to the other measure. For a true 
measure estimated from an actual score the standard error is 
smaller, being given by the formula = (^iVru — "ju. 

in which the subsenpt refers to a true measure. If the esti- 
mated measure is a entenon this becomes <r„„o.i = ffoVroo — rjj, 
in which roo is the coefficient of reliability of the criterion 
Measure. If one obtained score is taken as evidence of another 
Himilar obtained score, that is, if the equivalent-score equation 
Ip used, the sttmdard error is viy/2 — 2ru, or, if one is a crite- 
gpHi, ffoVZ — 2roi. If a true measure is taken as the basis of 
l^pariaon or estimation, the standard error is tfiv'l -J-rn — 2rii 
W Si VI + roo — 2roi. 


^For a jneeentation of these varis^W see Truman Le* Kelley, /ntor- 
wefation oj EdueaHonol Mea«uremeti(|i^3^onkers-ou-HudeaD, World Book 
Co., 1927), pp. 176-181. 
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As was suggested near the begmning of the discussion in 
Chapter XIX, the ordinary fonnale for errors are not high^ 
accurate, especially if small numbers of cases are concerned. 
This condition likewise holds for errors of estimate. Therefore, 
in order that an error of estimate as actually computed from a 
small number of cases may be taken as the most likely error of 
estimate for the universe from which the sample is drawn, a 
correction should be applied. This correction consists merely 
of multiplying the square of the obtained error by the fraction 
N - 1 

^ before extractmg the square root. In formula form 
this is 


Thus, for example, if the actually obtained value of the standard 
error of estimate based on a sample of only twenty-five cases 
is 3.60, the most likely value of that for the total population 
from which the sample was drawn is 

or 3.50y^^ - 3.58. 


It will be seen from examination of the formula that the cor- 
rected error must be larger than the obtained one. 

By substituting the appropriate multiple coefficients of cor- 
relation instead of those of zero order, the formulae for errors 
of estimate may be used in that connection adso. If this is done 
a more general correction formula is used. Instead of tire 2 
in the denominator of the formula given in the preceding pai»* 
graph there should be n, which denotes the number of vari^bleR 
concerned in the multiple correlation. Therefore for mult^ill 
owrelation, we have 


To 


illusti^ application jj^t a standard epor 
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estimate of 4.40 has been found for thirty-two cases with seven 
variables concerned. The formula then gives 

which equals 4.90, a value markedly larger than the obtained 
value of 4.40. 

Errors of estimate may be computed for curvilinear as well 
as for rectilinear relationships. Smce, however, this is rarely 
done in common educational practice, the method of doing so 
will not be given here. The reader who is interested will find it 
in Ezekiel* The same writer also gives a helpful explanation 
of the meaning of errors of estimate and of their correction as 
described above.* 

Before concluding this discussion it should be pointed out 
that errors of estimate are one of several possible means of 
interpreting the closeness of relationship between associated 
variables. In comparison with coefficients of correlation and 
of determination and their opposites, those of alienation and 
of non-determination, and also with regression coefficients, 
they possess certain advantages and certain disadvantages. A 
good brief summary of these measures and their relationship 
to oac another may be found in Ezekiel* 

Errors of measurement. The term error of measurement in its 
narrower sense refers to differences between actually obtained 
scores and theoretically true scores. The latter are theoretical 
because they cannot actually be determmed. A theoretically 
true score is defined as the average of an infinite number of 
scores of the same individual obtamed by the same or equiva- 
lent measuring instruments, corrected for practice effect. 

The formula for the standard error of measurement, also 
known as the error of response or the error of a score, is vi . , or 
Oam* = ff-v/l — rui the same as that for the standard error 
of estimate except th^t the coefficient of correlation used in 

*Moirdecai Ecddd, Methods of Correlation Analysit (New York, John 
Wiley ABone, 1030), pp. 220-224. 

*IbiCw- 111-117, 121-124. 
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the former ie the index of reliability, whereas that in the latter 
is the coefficient of reliability. The index of reliability equals 
the square root of the coefficient of reliability, that is 
Tlierefore, if instead of the coefficient of reliability used in the 
formula for errors of estimate we substitute the index of relia- 
bility and square it, we have {y/rY which equals r, the last 
term under the radical in the formula for the error of measure- 
ment. Since in any given case there are two or more series of 
obtained scores and what we usually desire is a measure of the 
errors involved in using any one of them and, furthermore, 
since we rarely if ever know which senes approximates the 
true scores most nearly, the two or more standard deviations 
are commonly averaged. Hence the ordinary form of the 
formula when, as usual, there are two scores, X and Y, avail- 
able, is 

ffz d" /z 

or o'y.ea ”■ 2 

This is the formula most commonly employed and may be con- 
sidered the standard one. It will be noted that it contains the 
same multiplier, Vl — r, mentioned m the discussion of errors 
of measurement m the broader sense on page 333. 

In addition to the formula just given, however, thore ate 
at least three others that may be used. If both series Mf data 
form similar distributions, with their means and standard 
deviations the same, and if the differences between the cor- 
responding pairs of scores form a normal distribution all the 
formulae give the same result. If all these conditions are not 
fulfilled the results from some or all of the formula differ and 
have somewhat different meanmgs. 

One of the three formula referred to is 

ff... = 

This contains no new terms. A second one is <rx.« = .TOTlffdig. 
In this is the standard diff^enoe * of the scores in the two 
* The standard difTerenoe la obtained from the differences between aeons 
in just the same way as is the standard deviation from the deviatioiu. 
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series. The third formula is 0 -... « .8863 mean difference, in 
which the mean difference is that between the scores in the 
two series.* 

To understand the differences between the meanings of these 
formuhe it is necessary to recall that the errors present in meas- 
ures may be either variable or systematic. Furthermore, variable 
errors may be of two sorts. They may be due either to im- 
perfections in the measuring instruments or to accidental occur- 
rences that have no connection with them. Imperfections in 
the instruments themselves result in two duplicate forms of a 
test not yielding the same scores under supposedly identical 
conditions. It is true that part of this lack of agreement is 
usually due to different mental conditions of the persons being 
tested. Theoretically, however, a perfect test would so moti- 
vate pupils’ mental processes as to eliminate such differences, 
80 one may think of all differences between scores as being due 
to inherent faults or weaknesses in tests. 

The first and second formal®, 


<r, -|-<r„ , 

— — s — VI — r and 




S(X - F)* - 


(sx - sr)*" 

N 


measure the variable errors present, mcludmg both kmds. If 
the standard deviations of the two distributions are the same the 
results obtamed from these first two formul® are the same. The 
last two of the formul® given, <r,., = JOlla^g and = .8863 
mean difference, measure all the errors, both variable and 
constant, that are present. In other words, they include dif- 
Icsrenoes due to the fact that the mean scores on the two tests 
hK not the same. If the two distributions are normal and also 

; < The several formul® for the probable error of measurement that oor- 
li^ipoad to thoee given above for the standard error are as follows: 

PE... - .67462^^»vT^ 

- - IT - 

■> .4760(r«iiii, and .6978 mean differoBoa. 



ERSOBS OF ESTIMATE AND OF MEASUBEMENT 369 


have the nine mean, that is, if there is no constant eiior oe 
difference, the third formula yields the same result as the first 
two. The last formula also yields an identical result if these 
conditions are fulfilled and the differences between correspond- 
ing pairs of measures are normally distributed. If the two 
distributions are not normal, do not have the same means and 
standard deviations, and the differences of corresponding scores 
do not form a normal distribution, it is unlikely that any two 
of the four values found agree exactly. 

If one desires to secure a measure of the errors actually due 
to faults in the test and exclude those variable errors due to 
accidental happenings, some extra work is required Theoreti- 
cally one series of scores must be expressed in terms of the 
other series by the use of an equivalent-score equation such as 
is given on page 246. In practice, however, this work is not 
necessary. Instead, one may simply use in the formula the 
standard deviation of the series in terms of which the other 
series is expressed. After this has been done all four formul» 
yield measures of the errors due to imperfections m the test 
itself, with both the other type of variable errors and constant 
errors eliminated. The results given by the first three formuls 
agree, and the result from the fourth also has the same value 
if the distribution of differences is normal. 

A variation of the first formula given for the standard error 
of measurement is employed when one wishes to compute the 
error involved in an estimated true score.' It is secured by sub- 
stituting <rVr, which is the standard deviation of the true 
scores, for <r in the formula. The formula thus becomes 

<r«.i or = ffy/ry/i. — r = cx/r — 

Computation. The calculation of the standard errorsvpf 
estimate and of measurement, the latter according to the fo^t 
formula and also by the use of equivalent scores, is ahowp in 
Table LXVIII. In it the work leading to the two agmas, 

’ An estiniiidMi true score is one secured by the use of the forauda 
X'm «• rX -f- <1 given on page 348. 
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and the equivalent-score equation has not been included, since 
it has been given previously. Only two columns in addition to 
those containing the original scores are needed for dealing with 
them. One of these columns contains the differences, taken 
without regard to sign, between the corresponding scores and 
the other the squares of the differences. These two columns 
are summed and the results used in the appropriate formulae. 
Since the standard deviations of X and T are so nearly the same, 
the standard errors of estimate do not differ much. That of X 
is 3.78 and that of V, 3 76. The standard errors of actually 
obtained scores when estimated from actual scores are 3.89 
and 3.87, respectively. The values of the standard error of 
measurement 3 delded by the different formul® range from 2.74 
to 3.46. Those obtained from the first and second formulse, 
2.74 and 2.75, are measures of the variable errors of both kmds 
present and would agree if the two sigmas were the same. That 
given by the third formula, 3.09, is the standard error of meas- 
urement of all the errors, both constant and variable, that are 
present. The fourth formula gives 3.46, a similar measure, 
which would agree with the other if the distribution of differ- 
ences were normal. 

Just below the formula which gives Cx.. = 3.46, the standard 
errors of measurement of estimated true scores are given. In 
this case c*., = 2.59 and <rop.„ = 2.58. 

The last three columns and the calculations at the bottom 
of the table are rarely employed. They deal with the stand- 
ard errors of measurement of the ongmal X scores and the Y 
scores expressed in terms of X. The formula for the latter is 
Si “= 1.005S» + 1.59. Making use of this formula, we obtain 
the eqmvalent scores given in the fifth column of the table. It 
will be noted that their sum is 1700,15. If enough decimal 
places had been carried this would be exactly the same as the 
spm of the X column, 1700. The next column contains the dif- 
:lerencra between thesa^sfuivalent scores and the X scores, and 
last, the squares of<^he6e differences. Substituting in the 
^isarious formulas, we 8e» that the results yielded by the first 
ituee are practically t^^same, 2.75 and 2.76: The {i|i^;dard 
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error of measurement according to the last formula is different, 
being 2.93. This, again, is due to the fact that the distribution 
of differences is not normal. A standard error of measurement 
obtained from equivalent scores is a measure of the variable 
errors due to imperfections in the test and is free from any 
effect of variable errors due to accidental occurrences and also 
of constant errors. Furthermore it is a measure of the errors 
in the senes in terms of which the scores have been expressed, 
in this case A'. 

It will be noted that since the group of four formul© at the 
bottom of Table LXVIII give the standard error of measure- 
ment of the onginal X scores and of the Y scores expressed in 
terms of X, the standard deviation of the X scores, 8.11, is 
used where is called for. If, mstead, the standard error of 
measurement of the origmal Y scores and of the X scores ex- 
pressed in terms of Y wore desired, all that would be necessary 
would be to substitute the standard deviation of Y, 8.07, in 
the formula instead of 8.11, thus getting a result of 2.73 instead 
of 2.75. This is shown m parentheses. 

The probable errors of estimate and of measurement have 
not been computed in Table LXVIII, but all that is neces- 
sary to secure them is to multiply the obtained standard 
errors by .6745. Thus, PEt-u = .6745 X 3.78 = 2.55, 
PEy.t = .6745 X 3.76 = 2 54, PE,,^ for the onginal Scores 
= .6745 X 2.74 = 1 85, and so on. 

Use and interpretation. The chief use made of the standard 
and probable errors of measurement is in connection with the 
description of the reliability of a test, that is, of bow well results 
from two or more duphcate forms of the test agree. For this 
purpose, however, a mere statement of the size of the error -is 
scarcely sufficient. For example, if one knows that the pro^ 
able error of measurement of one test is two points and that 
of another test, five points, he does Hot know which test is 
more reliable unless he knows also total possibilities ol 
error and interprets the absolute ernaife terms thereirf. Thugt 
from one standpoint a probable erro^l^ measurement of twO' 
pointt^ft significant in conii60l/io3j^%pi1fh & testf ooiQiiru^DS 
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twenty elements as a probable error of five points is in conneo- 
tion with one comprising fifty elements. 

To secure a relative and comparable measure of error it has 
been suggested, and the suggestion rather commonly followed, 
that the measure of error be divided by the mean score on the 
<T PE 

test. Thus, or — usually the latter, is recommended 
M. M 

as a better measure for purposes of comparing the reliability 
of different tests, than <ri « or PEi . , alone It is a better meas- 
ure, but is not perfect for at least two reasons. 

One of these reasons is that the true zero points of very few 
scales are known In case the location of the zero point is much 
in error the use of these measures is hkely to give a false idea 
of the situation. To illustrate this let us suppose that the mean 
score of a class upon a spelling test is 20 and the standard error 

of measurement, 1. Under this condition = — = ,05. It 

M 20 

may be, however, that the easiest word spelled is so difficult 
that the amount of the difference between the ability required 
to spell it correctly and no spelling ability at all is twice as 
great as the difference in the ability required to make a score 
of twenty and that required to spell the easiest word m the list, 
but no other. Therefore if the real zero point were used the 
mean abihty of the class would be expressed by a score of sixty 

rather than by one of twenty, and would be equal to 

^ = .017, or just one-third of its value under the other con- 
ditions. 

The second reason is that, regardless of whether or not true 
aero points are known, the possibihty of error depends on the 
difficulty of the elements in the test rather than on how many 
elements there are. For example, if to the test mentioned in 
the last parfigraph twenty very easy words were added and all 
pupils spelled them correctly, the mean score would be raised 
to forty, but the standard error of measurement would not be 

^banged. Therefore would equal = .026, or only half 
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what it was for the twenty-word test, although the reliability 
was not changed. 

PE 

Because of these objections to — it has been suggested 

that the ratio of the probable error of measurement to the 
standard deviation instead of to the mean be employed. This 
PE 

measure, — does, it is true, avoid the two objections to the 

other measure just made, but does not seem to be entirely satis- 
factory for the purpose because it neglects entirely the total 
score on the test and deptmds too directly on the value of r. 
Therefore the wnter advises that in describing the reliability 
of a test both these formube be used and their values given, 
perhaps in addition to other data. 


TABLE LXEX 

MuLTm-ncRS to Be Used in Determining Standard and 
Probable Errors of Estimate and or Mbabdrement 
Corresponding to Certain Values or the Coeffi- 
cient OF Correlation 


Cof£U-tenl j 

of 

Correlation 

Errors 

of 

Estimate * 

Errors 

of 

Measurement f 

1 00 

0000 

.0000 

.99 

1411 

.1000 

.98 

1990 

.1414 

.97 

2431 

1732 

96 

2800 

.2000 

.95 

3122 

.2236 

90 

4359 

.3162 

.80 

6000 

.4472 

.70 

.7141 

.5477 

.60 

.8000 

.6325 

.50 

8660 

.7071 

.40 

9165 

.7746 

.30 

9539 

.8387 

.20 

9798 

.8944 

.10 

9950 

.9487 

.00 

10000 



* Tb« entneii lO this eoluniD an equal to Vl — r» 
t TImi entnat m this oohimn are equai to vT=-r. 
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Table LXIX had been prepared to help the reader in otnn' 
puting the errors of estimate and of measurement associated 
with coefficients of correlation of given sizes. It gives for cer- 
tain values of the coefficient the decimals by which the stand- 
ard and median deviations should be multiplied to secure the 
standard and probable errors of estimate and of measurement. 
The second column contains the multipliers for errors of esti- 
mate, and the third column those for errors of measurement. 
If one wishes to secure a standard error of estimate or measure- 
ment, as the case may be, aU he need do is to multiply the 
standard deviation of the distribution in question by the deci- 
mal given in the proper column of the table. If he wishes to 
compute the probable error of estimate or of measurement he 
multiplies the median deviation of the distribution by the 
entry in the table. Thus, for example, if r equals .95 the standard 
error of estimate is equal to .3122ff and the standard error of 
measurement to .2236<r. Likewise, the probable error of esti- 
mate equals .ZV22MdD and the probable error of measurement 
equals .2236MdD. Also, of course, smce MdD = .6745<r, the 
probable errors of estimate and of measurement are equal to 
.6745(r times the proper multiplier. Thus for r — .95, 

« .6745 X .3122<r = .2106a, and PE^.^ = .6745 X .2236<r 
m • 1508a. 


Exercises 


1. Compute the various standard and probable errors of estimste 
and of measurement, as in Table LXVIII, for the following aeries of 

data: 

A B 


40 

33 

38 

44 

38 

31 

31 

22 

37 

34 

29 

25 

37 

26 

27 

28 

35 

32 

23 

15 

32 

29 

20 

13 

29 

30 

19 

16 

28 

32 

18 

18 

27 

25 

17 

14 

26 

22 

17 

10 
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A (amt.) 

B (omA) 

24 

27 

15 

11 

24 

23 

14 

9 

24 

17 

13 

12 

21 

20 

13 

10 

20 

14 

11 

10 

20 

22 

10 

8 

19 

18 

10 

9 

19 

16 

8 

7 

17 

24 

5 

4 

17 

18 

4 

4 

16 

11 

2 

3 

15 

15 

1 

3 

14 

13 



12 

10 



11 

12 




2. Compute the standard and probable errors involved in estimating 
am actual criterion score and a true criterion score from an actual test 
■core in each of the following situations: 

A. Standard deviation of cnterion scores •= 12, coefficient of re- 

liability of critenon scores = .90, correlation between test 
scores and criterion scores = .65. 

B. <ro = 7.5, Too = .84, roj = .62. 



CHAPTER XXI 

USES OF THE NORMAL PROBABILITY CURVE 

Changing qualitative data into a normal distribution. It is 

sometimes helpful to change quahtative data into quantitative 
data that form a normal frequency distribution, thus enabling 
them to be dealt with m certain ways not possible while they 
are expressed in quahtative form. The method of doing this 
may be illustrated by an example deahng with the rating of 
teachers wherein they are given one of five possible ratings. Let 
us suppose that seventy teachers have bi*en rated and that five 
<rf them have been given the ratmg excellent, sixteen, good, 



PIG. 41. ILLUSTRATION OF THE CHANGING OF QUALITATIVE 
DATA INTO A NORMAL FREQUENCY DISTRIBUTION 

The areas, A. B. C, D, and E represent the five onuinnl groups of ratings 
and the points. 1. 2, 3. 4, 6, and 6, the bases of the ordinates bounding these 
five groups. 

thirty-three, medium, thirteen, poor, and three, very poor. This 
distribution may be thought of as the space under a normal 
curve with the area divided into five parts proportional m size 
to the numbers of teachers given the five different ratings. 

The first step in making the transmutation is to change the 
numbers receiving the various ratings into per cents. Doing 
this ^ves, respectively, 7.1, 22.9, 47.1, 18 6, and 4.3 per cent. 
Stocfe the cases in any one group are commonly assumed to be 
at the mid-point of that group, the problem is to find the mid- 
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value or distance from the mean of the measures in each of the 
five groups. The process of doing this is illustrated by Figure 
41 and Table LXX. 

TABLE LXX 


Changino Qualitative Data into a Normal Distribution 


OrdmaU 

Area 

between 

Ordinates 

Area 

between 

Ordinate 

and 

Maximum 

Ordinate 

Height * 
of 

Ordinate 

Difference 

in 

Heights 

of 

Ordinates 

Mean a t 
Distance 
from 

Maximum 

Ordinate 

6 

1 

.071 

.500 


+ .136 

+1.92 

6 

.229 

.429 

.136 

+ 212 

+ .93 

4 

.471 

.200 

.348 

-.045 

- .10 

a 

i 

.186 i 

271 

.303 

-.212 

-1.14 

2 

.043 

457 

.091 

1 

-.091 

-2.12 

1 


500 


+ .348 
- 348 



* The heijthta id this coluuxa arc id terma of a maxiniiun bogbt of 3989, ratbar than of 
1 0000 Therefore to aeruir them thr entries in the height column of the tablas itt Appendix 
B must be multiplied b> 3989 

t The eotnes to this coluniu which repreaent the mean distancee from the maximum 
ordinate in terms of the nlandard deviation are secured by dividing thoee in Ae previoiiB 
eolumn by thoeo lo the second column of the table 

The figure contains a normal curve divided into five parts, 
which contam areas correspondmg to the five ratings. Thus 
the area A, which corresponds to excellent, contsms 7.1 per cent 
of the area under the cun'e; the area B, 22.9 per cent of the 
area; and so on. The points 1, 2, 3, 4, 5, and 6 represrait the 
bases of ordinates that bound the five areas. Thus area E lies 
between ordinates 1 and 2, D, between ordinates 2 and 3; and 
so on. 

In the table the first column hste the ordinates, and the 
second gives the area between each pair of ordinates whidi, 
as just explained, is the same as the per cent of cases leodiving 
the corresponding rating. The next column gives the area 
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between each ordinate and the maxiintim or mean ordinate. 
Thus, since ordinate 6 is at the extremity of the curve, the area 
between it and the maximum ordinate is one-half the total area, 
or .500. That between ordinate 5 and the maximum ordinate 
is found by subtracting from .500 the area, .071, that lies be- 
tween ordinates 5 and 6, giving .429. By a similar process the 
other entries in this column are obtamed. The fourth column 
of Table LXX gives the height of each of the ordmates. These 
heights may be found from either of the tables m Appendix B 
by looking up the areas m the last column thereof, finding the 
corresponding heights, and multiplying them by .3989, since 
they are in terms of a maximum ordinate of 1.00, whereas this 
method of transmuting data is based upon an area of 1.00 under 
the normal curve and therefore a height of .3989. For the first 
area, which is .500, the height is .000, for the second, .429, the 
tabular height is found by mterpolation to be .340, and this 
multiplied by .3989 gives .136, the second entry in the column; 
and so on for the others. The next column contains the differ- 
ences in the heights of the two ordinates bounding each area. 
The entries herem are found by subtracting m turn the first 
entry in the previous column from the second, the second from 
the third, and so on. At the bottom of this column are the sums 
of the plus and minus entries m that column. Unless these 
sums are the same, and also the same as the largest, entry in the 
previous column, the work must contain some error 

The last column, which gives the desired mid-pouit or mean 
distance of each area from the maximum ordinate, is obtained 
by dividing each difference between beiglits by the area of the 
corresponding part. Thus, its first entry, 1.92, is found by 
dividing .136 by .071, and the others in similar fashion. The 
entriea in this column are the numerical values to be given the 
five groups of ratings if it is desired to deal with them quanti- 
t*lively. 

One use of the numerical values or mid-points of groups de- 
termined by this method is in averaging scores or ratings given 
by different individuaip who have quite diffearent standards in 
To illustrate suji^Mpe that five supervisory ofiScials 
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have rated a number of teachers on a scale of four divkicms — 
exceU^t, good, fair, and poor — and that the pear cents the 
four ratmgs given by the different supervisors are as shown in 
Table LXXI. 


TABLE LXXI 

Per Cents of Various Teachers’ Ratings Given bt EIach 
OF Five Supervisors 


Rating 

Supervisor 

A 

B \ 

I 

C 

D 

E 

Excellent 

10 

12 

16 

18 

\ 22 

Good 

25 

28 

29 

27 


Fair 1 

50 

50 

47 

42 

44 

Poor 

15 

10 

8 i 

13 

4 


By applying the method illustrated in Table LXX the mean 
distances from the maximum ordinate in terms of standard 
deviation are found to be as given in Table LXXII. 


TABLE LXXII 

Mean v Distances or Ratings Corresponding to the Per Cents 
OF Ratings Given in Table I-XXI 


Rating 

SujMTtnsor 

A 

B 

C 

D 

E 

Excellent 

Good 

Fair 

Poor 1 

+ 1 75 
+ 78 
- 27 
-1 55 

+ I 67 
+ 67 
- 42 
-175 

+ 1.52 
+ .53 
- 53 
-1.86 

+ 1.46 
+ .49 
- 44 
-1 63 

+1.35 
+ .34 
- 71 
-2 16 


This table shows, for example, that a ratmg of excellent given 
by supervisor A is equivalent to a ir rating of +1.75; one given 
by supervisor B, to a d rating of +1.67; and so on. To secure 
the average rating of any teacher the numerical «r ratings givph 
by the five supervisors are avera^. For example, if Miss ^nitll 
is rated good by A, fair by B and D, and excellent by Q and E, 
her rating is the average of +.78, —42, -.44, +1,S2, and 
+1.36, which is +».66. 

Although theUlwtihpd just desctHted )i||[|pa8ionaUy oni^yed 
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in other situations, it is really appropriate only to data grouped 
in non-quantitative classes. If the classes are already quantita- 
tive or numerical one is rarely, if ever, justified in changing the 
distribution into a normal one smce so domg alters the width 
of the classes. 

Comparison of distribution with the best fitting normal curve. 

Sometimes one wishes to find the normal frequency curve or 
distribution that best fits an actual distribution. Usually the 
purpose of doing so is to compare the two and thus ascertain 
whether the differences between them are probably merely due 
to chance or are significant. Such a comparison may be made 
by plotting the actual curve and the best fitting normal curve 
on the same figure, but unless the differences between the two 
curves are either very small or very large, or unless the person 
comparing them is an expert in domg so, opimon based upon 
their inspection is not a very safe guide m judgmg their signifi- 
cance. It is therefore better to supplement the construction of 
the two curves by a computation, such as is given in this sec- 
tion, that enables one to determine the sigmficance of the 
differences ‘ 

To construct the best fitting normal curve one must compute 
the mean and the standard deviation of the data to be repre- 
sented. After this has been done the normal curve should be 
plotted on the same base line with the same mean and standard 
deviation as the actual cur\'e. This may be done by use of the 
method descnbed on page 58 and followmg, using a as the base- 
line unit. The maximum ordmate, that is of the normal curve 
should first be found by the formula 

N 

Figure 42 contains the actual curve and the best fitting nor- 
curve for the data given m the accompanying distribution. 

* Such a companson may be made without constructing the two curves, 
but it is recommended that both be done, smce the graphic representation 
tS tiie curves gives a better picture of the whole than does the oomputi^ 
tiora even though it is somewhat difficult to interpret accurately. 
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The mean is approximately 33, the standard deviatimi is li.06, 
N is 100, and 


Vo = 


100 


11.05 




18.06. 


In determining it is necessary to divide the value of a in 
actual units by the width of the class mterval so that it will be 


f 

60-2 
55 - 1 
50-3 
♦5 - 7 



FIG. 42. COMPARISON OF ACTUAL AND BEST FITTING NORMAL 
CURVES FOR THE SAME DATA 

By oomparing the two curves above, one can gam acme idea of whether the 
diflerencea are aignificant or nut In the caae reproaented above it la evident 
that they are ao aoiall that none, or practically none, of them are aignihcant. 


in terms of class intervals. The neict step is to erect a mnYimnin 
ordinate or, perhaps better, merely place a dot at the proper 
height for the top of the ordmate, 18.05, just above the mean, 
33. One then determines the heights of the normal curve at 
various distances from the maximum ordinate, and draws the 
curve through dots placed accordingly. Thus at a distance of 
.26<r on each side of the maxunum ordinate the height of the 
curve is .9692 times the maiumum ordinate. Smce .25<r equals 
2.76, and since .9692 times 18.05, the maximum ordinate, equids 
17.49, dots should be placed at a height of 17.49 above 30.24 
and 35.76, the points that are at a distance of 2.76 from the 
mean on each side. Similarly, at a distance of .Sd or 6.53 fimn 
the mean, dots should be placed at a height of .8825 times 
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maximum ordinate, or 15.93. Continuing this process, we maj 
locate enough points so that the curve, as shown, can easily 
be drawn through them. A comparison of the actual and best 
fitting normal curves, as i^own in Figure 40, makes it evident 
that the differences between the two are on the whole decidedly 
small, so that it is doubtful if they are really significant rather 
than due to mere chance. 

As was stated above, however, certain computations should 
be carried out to enable one to mterpret such differences satis- 
factorily. These involve the comparison of the differences with 
their standard, or perhaps some other, error. In this case the 
appropriate standard error is given by the formula 

In this N is the total number of cases, and / is the theoretical 
frequency at any given pomt on the scale, that is, the height of 
a normal curve at that pomt. It is generally assumed that if 
the difference between the actual and theoretical frequencies 
is less than three times the standard error it is probably due to 
chance, but that if it is greater than that it is almost certainly 
due to significant causes. The mterpretation of the ratio of the 
difference between the frequencies and the standard error is, 
however, just the same as that of any other difference com- 
pared with its standard error. Therefore it is not the best 
practice to take any one pomt as a critical point below which 
differences are taken as of no significance and above which they 
are considered significant. Instead, it should be interpreted, as 
described in Chapter XIX, as showing how great the chances 
are that the difference is significant. 

Table LXXIIl contains the computations necessary to make 
such a comparison of the actual and best fitting normal curves 
the same data that were employed in Figure 42. This 
tldale b^jns with the actual distribution. The next column 
Spotains the mid-points of the various classes. In the third is 
^tmd the distance of each mid-point from the mean. The next 
^iBplimn contains this same distance expressed in terms of the 



THE NORMAL PROBABILITY CURVE 


TABLE LXXIII 

COKPAXmOM OF THB DiFFBRBNCBS BVTWKXN AN ACTUAL DlSrTBiaTnHni 
AND THB Best Fittino Normal Onx with Thbir 
Standard Erborb 


Aetwd 

DUt 

Mtd- 

PotrU 

Ditt. 

from 

Mean 


Theor. 

/ 

Diff. 

iTdill 

Dif. 

<r 

Chanem 
to 1 

80 - 

2 

62 5 

295 

2 67 

.51 

1.49 

71 

2.10 

55 

85 - 

1 

57.5 

245 

2.22 

1.54 

.54 

1.23 

.44 

2 

80 - 

3 

52 5 

19 5 

176 

3.84 

84 

1 92 

.44 

2 

48 - 

7 

47.5 

14.5 

1.31 

7.66 

.66 

266 

25 

1 

40 - 

11 

425 

9.5 

.86 

1247 

1 47 

330 

45 

2 

88 - 

17 

37.5 

4.5 

.41 

16.59 

41 

3 72 

.11 

1 

80 - 

20 

32.5 

.5 

.05 

18 00 

200 

384 

.55 

2 

26 - 

18 

275 

5.5 

.50 

15 93 

207 

3 67 

.56 

2 

20 - 

10 

22.5 

10 5 

.95 

11 49 

1 49 

3 19 

.47 

2 

15 - 

6 

17.5 

15.5 

140 

8 77 

77 

2.51 

31 

2 

10 - 

3 

12 5 

205 

186 

3 21 

.21 

176 

.12 

1 

6 - 

1 

75 

255 

2 31 

125 

.25 

1 11 

.23 

1 

0 - 

1 

2 5 

30 5 

2 76 

40 

60 

63 

95 

5 


standard deviation and is obtained by dividing each entry in 
the preceding column by 11.05. The fifth column of the table 
contains the theoretical frequencies or heights of the normal 
curve, at the distances from the mean just given. Thus, by 
interpolation m the first table m Appendix B, one finds that the 
height of the curve at a sigma distance of 2.67 is .0285. Since 
this is in terms of a maxunum ordinate of 1 0000, it must be 
changed into terms of the actual frequencies of the distributkm 
by being multiplied by the height of the maximum ordinate, 
18.05, thus giving a height or theoretical frequency of .51. The 
sixth column contains the differences between the theoretical 
frequencies and the actual frequencies. In computing these 
differences signs are neglected. The next column contains the 
standard error of each difference found by the formula alreai^y 
given. Thus for the first row the standard error is given fay: 



.51(100 - .51) 
100 


.71. 


Eadi standard error is then divided into its difference, 
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giving the ratio of the latter to it, and the results entered in the 
next to the last column. For the first row 1.49 divided by .71 
gives approximately 2.10. The entries in this column may then 
be interpreted according to the experimental-coefficient method 
given in Chapter XIX. This has been done, and the results, in 
terms of approximate chances to 1 that each difference is signifi- 
cant, entered in the last column. Thus for the difference m the 
first row, which is 2.10ffdiff, the experimental coefficient is 
2 10 

2 ^ = .76, and the chances are about 55 to 1 that the differ- 
ence is sigmficant; for that in the second row the chances are 
approximately 2 to 1 that it is, and so on. From these it appears 
that in almost all the classes of the distnbution the chances 
that the differences are significant are quite small. On the 
whole, therefore, the conclusion to be drawn is that the data 
actually obtamed fail to form a normal distribution because of 
chance rather than because of any characteristic that causes 
departure from the normal. 

The method just described is lacking in that it provides no 
single mdex or summary figure by which departure from nor- 
mality can be expressed. To provide such an index Holzinger * 
and others have recommended what is commonly known as the 
X* (Chi square) Test for Goodness of Fit. The formula for it is 



I& this, /i is the observed or actual frequency m each class, and 
/ the theoretical or normal frequency. After the value of x’ has 
been obtained by the use of this formula it must then be looked 
up in a table such as Pearson’s Table XII ’ and the correspond- 
ing chances determined. 

The application of the formula may be illustrated by using 
the data in Table LXXIII. The difference between the the- 
o^ical frequency and the actual frequency of the first class, as 

* Kail J. Holzinger, Statultcal Methods for Students tn Education (Boston, 
Qwm & Co., 1928), pp. 245-248 

*Eatl Pearson, Tables for Stattelicians and Bitmetncians (Cambndge, 
Chunbndge Univereity Pr^, 1914), pp. 26-28. 
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TABLE LXXIV 

Valitbs or P roa TssTiNa Goodnxss or Frr CoaitBSPOKDiKa to ths 
Given VaIiDES or x’ and n 


X* 



6 

y 

9 

y 

9 

10 

11 

1£ 

IS 

u 

IB 

16 

Q 

m 

19 

so 

1 

.91 

w 

i 


IIS 

ns 

IS 



1 00 



El 



fB 

2 

.74 

85 

92 

Q 

98 

99 

ns 









IQ 

8 

.56 

70 

81 

Q 

93 

96 

98 

99 

ibB 


100 






4 

.41 

.55 



86 

91 

Km 

97 

.98 

99 

tirrr 

bB 


IQ 


IQ 

6 

29 

42 

54 


.76 

83 

.89 

93 

.96 

.98 

99 

99 

bS 

Bri 


IQ 

6 

20 

31 

42 

54 

.65 

74 

82 

87 

92 

95 

97 

98 

.99 

.99 

Bi!l]i 

Bn 

7 

.14 

.22 

32 

43 

54 


73 

80 

.86 

.90 

.93 

K!3 

97 

98 

.99 

.99 

8 

.09 

16 

24 

33 

43 

53 

63 

71 

79 

84 

89 

92 

.95 

.97 

.98 

.99 

9 

.06 

11 

17 

25 

34 

44 

53 

62 

.70 

77 

83 

88 

91 

94 

96 

.97 

10 

04 

08 

12 

19 

27 

35 

44 

53 

62 

69 

76 

.82 

87 

■ia 

93 

95 

11 

03 

05 

09 

14 

20 

28 

36 

44 

53 

61 

69 

.75 

.81 

.86 

89 

92 

12 

02 


Kilil 

Da 

15 

21 

29 

36 

45 

53 

61 

68 

74 

Bko 

.85 

.89 

13 

01 

02 

04 

07 

11 

16 

22 

29 

.37 

.45 

53 

KTi] 

67 

.74 

.79 

.84 

14 

01 

iiW 


s 


12 

17 

.23 

IRli] 

37 

45 

53 


.67 

.73 

.78 

15 

.00 

01 


3 

Kg 

■IM 

13 

18 

24 

31 

38 

.45 

.52 

m 

.66 

.72 

16 

.00 



s 

KSI 

la 

.10 

14 

19 

25 

31 

38 

45 

52 

.59 

.66 

17 

00 


ES 

R 

03 

Be 

07 
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shown in the table, is 1 49. Squaring this and dividing by .51, 
the theoretical frequency, gives 4.36. For the second class the 
difference is .54. Squaring this and dividing by the theoretical 
frequency, 1.54, gives .19. Doing the same for the other classes 
and summing for all gives x* = 6.70. Table LXXIV is then 
used to find the desired chances. Its use mvolves x* and 
the number of classes In this case there are thirteen classes; 
therefore one finds the tabular entry opposite the obtained 
value of X* the column headed 13. Since x^ this case equals 
6.70, one must interpolate between the values of 6 aud 7 givoti 
in the table. Doing so gives a value of P, the symbol commonly 
used in this connection, of approximately .88. The interpreta- 
tion of this is that there are 88 chances in 100, or 88 to 12, w 
about 7 to 1, that <me would get in random sampling a fit as 
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bad as, or worse than, that of the actual to the normal curve. 
In other words, the fit in this case is good and the differences 
are probably due to chance. 

In this, as in other more-or-iess similar situations, it cannot 
be said that there is any one critical value that determines 
whether or not the fit is satisfactory or unsatisfactory. However, 
a value of .20 or larger for P may be regarded as indicating that 
the fit is reasonably close and one of less than .20 as indicating 
that some other type of curve than the normal will probably 
best represent the actual distribution. 

An approximate method of determining the departure of a 
distribution from normalcy has been suggested by Dickey.* 
It is based on the use of an isosceles triangle that fits the nor- 
mal curve rather closely and is subject to errors that exceed 
=*=5 per cent only rarely. 

Determination of proportion of cases between two points on 

a scale. Another use of the normal curve is to detenmne what 
proportion of the total number of cases should fall between any 
two points on a scale. A common example of this is in assign- 
ing school marks, when, for example, one desues to distribute 
marks of A, B, C, D, and E among a group of students on the 
assumption that the abibty manifested follows the normal 
distribution, and that each mark should include the same range 
or scale distance. The general procedure is to cut off the curve 
at a certain distance from the mean, to divide the portion con- 
tained within the points at which it is cut off into the desired 
number of divisions with equal base lines, and then to ascer- 
tain the area in each division. For rough work it is ccunmon to 
cut off the base line at a distance of 2.5<t or Sir from the mean. 
If it is cut off at 2.54r about 98.76 per cent of the total area of 
the curve remains, and if it is cut off at 3<r about 99.73 per cent 
remains. For more exact work it may be cut off at 4<r or 5<r from 
the mean. The proportions of the area then remaining are about 
99.994 and 99.99994 per cenV respectively. The base line is 
divided into as many parts as thercHiiiB marks, and the number 

•Jolm w. Dickey, "Nonnalcy os a Statistic,” Jpumal Edueational 
Figdutom, Vol. 26, September, 1934, pp. 437-446. 
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of students who should receive each mark is proportional to the 
area above that part of the base line corresponding to that mark. 

The process just mentioned is partially illustrated by Fig- 
ure 43. In it the base line has been cut off at ^ Sc and the por- 
tion between those lunits divided into five equal parts, each of 
which has a base line of 1.2<r. Therefore the ordinates bound- 
ing them are at distances of — 3.0<r, — 1.8<r, — .6<r, +.Ar, +1.8<r, 
and +3.0ff, respectively, from the mean. 

The per cents of marks are obtained as follows. Since the 
ordinates bounding the A and E divisions are l.Sv from the 
mean, this distance is 
looked up m the fimt 
column of the first table 
in Appendix B. The en- 
try opposite it in the 
third column is 4641, 
which shows that .4641 
of the total area of the 
curve is contained be- 
tween the ordinate at 
1.8(7 from the mean and 
the maximum or zero 
ordinate. Therefore the 
area on the far side of 
this ordinate from the mean is equal to .5000 — .4641, which 
equals .0369, or approximately 3i per cent. The area in the 
B and D divisions is found by subtracting the entry opposite 
their inner limits, .6<t, from that opposite their outer limits, 
1.8<r. That is, one subtracts from the area between the maxi- 
mum ordinate and the outer limit that between the former and 
the inner limit of each division, thus obtaining the portion (rf' 
total area in that division. In this case the area between the 
mean and the outer limits, 1.8(7, is .4641, as already found, and 
that between it and the inner iiaiits, .60-, is .2257. Therefore 
the area of these (lortions^ ^ven .4641— .2257, which is 
approximately 34 pec cent..' The area of the division eonespond- 
ing to C is found by multiplying by 2 the area contained be- 


FIG 43. USE OF THE NORMAL CURVE TO 
DETERMINE WHAT PROPORTION 
OF STUDENTS SHOULD RE- 
CEIVE EACH OF FIVE MARKS 

The areas of the five parta into which the aur- 
face under the curve u divided abow the per 
cents of students who should receive each mark. 
In this case the curve baa been cut off at =*>3a'. 
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tween the zero ordinate and the ordinate at .6a'. Since this area 
is .2257, the result is approximately 45 per cent. The per cents 
of marks are then as follows: A — 3^^, B — 24, C — 45, D — 24, 
E— 3i. 

In connection with this application of the normal curve it 
should be noted that for the same number of divisions the result 
of increasmg the distance from the mean at which the curve is 
cut off is to increase the proportion of cases in the central group 
of an odd timber or m the two central groups of an even num- 
ber and to decrease the proportions m the extreme groups. 

Determining the difficulty of test elements. The normal 
curve is also used m determmmg the difficulty of test elements 

when the per cent 
of pupils answering 
each element cor- 
rectly is known. In 
such a case the dis- 
tance on the base 
Ime represents the 
difficulty of an ele- 
ment, and the area, 
the per cent of pu- 
pils. Thus in Fig- 
ure 44 the base-hne 
scale represents the 
difficulty of the ele- 
ments in terms of 100 points; that is, an element answered 
correctly by no pupil is rated 100 and one answered correctly 
by all pupils, 0.‘ The area under the curve and to the right of 
any ordinate represents the per cent of pupils answering cor- 
rectly an element of the difficulty corresponding to the locar 
tion of the ordinate. 

To illustrate this use of the normal curve let us suppose that 
the per cents of pupils answering thr(||p elements correctly are, 

* Theoretically, 0 and 100 both fall at infinite distances from the central 
tmdency, but in practice the curve is usually fut off at and thase 
ifAtu traced there. 



SItma Scala 

0 33J S1.3 60.4 100 

Point Scala 

FIG 44. NORMAL FREQUENCY CURVE 
USED TO DETERMINE THE DIFFICULTY 
■ OF ELEMENTS ANSWERED BY 
KNOWN PER CENTS OF THOSE 
ATTEMPTING TO DO SO 

Outancea on the baae Unoe represent diSicuIty and 
arena per centa of those attempting 
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respectively, 15, 45, and 95, and that it is desired to find the 
relative difficulties of these elements. For the first one, with 
16 per cent correct responses, it is necessary to find the point 
on the base line such that the area imder the curve and to the 
right of an ordmato there is 15 per cent of the total area. It is 
easier to reverse the process and find the point to the left of 
which there is 85 p<‘r cent of the area or, in other words, be- 
tween which and the maximum ordinate there is 35 per cent of 
the area. This may be done by use of one or the oilier of the 
tables m Appendix B, according to whether the units it is 
desired to use are m terms of tlie standard or median deviation. 
The result is the same but is expressed differently. If, as in this 
case, it is desired to use the standard deviation one must find 
the sigma distance from the mean corresponding to an area of 
36 per cent. By mterpolation this is found to be approximately 
1.04<r. Since it is assumed that 100 pomts on the scale of diffi- 
culty represent the distance from ~5 «t to -f-5o’, that is, a total 
of lOir, <r = 10 pomts, and 1.04<r = 10 4. Therefore the diffi- 
culty of the element in question is 10.4 greater than the mean 
difficulty. Smee this is 50 the difficulty of the particular exer- 
cise is 60 4. 

For the second element, answered correctly by 45 per cent 
of the pupils, the an'a between the point desired and the mean 
is 50 — 45 = 5 jjer cent From the same table used previously 
the distance corresponding to this area is found to be about 
.13(r or 1.3 points. Addmg this to 50 as before, the difficulty 
value of this element is 51.3. 

The third element was answered correctly by 95 per cent of 
the pupils; therefore it lies at that distance below the mean 
that mcludes 45 per cent of the area. The distance correspond- 
ing to this per cent of the area is 1.65<7 and therefore the dis- 
tance in points, 16.5. Smee this is below the mean, that is, 
easier than the mean element, this amount must be sub- 
tracted from 50, givii)(|;% difficulty value of 33.5 for this ele- 
ment. 

The method just described is that employed by MeCiffi in 
oonneotion with his well known T-scale and T-score. The 
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explanation he gives for his method * is somewhat different 
from that given above, but the same results are obtained. 

Equally noticed differences. Several educational scales, such 
as those in English composition, drawing, and other similar 
subjects, have been constructed by the application of the 
theorem that “equally noticed differences are equal.” This 
theorem is applied to a situation in which judges have rated a 
number of specimens or samples from which a scale is to be 
made. The theorem means that if the same per cent of judges 
rate specimen A as better than B that rate B as better than C, 
the difference in merit between A and B is the same as that 
between B and C. Furthermore, if the per cents of judges are 
not the same the differences m merit vary according to the 
per cents and can be determined. As Thurstone ' has pointed 
out, the theorem holds only when the distributions of ratings 
given the various samples being dealt with are the same. In 
constructing a scale by this method, therefore, one should have 
a sufficient number of specimens rated so that after the rat- 
ing at least as many as are desired in the scale can be found 
for which the distnbutions of ratings are approximately the 
same. 

The basis of transmuting the per cents of judges rating one 
sample better than another into measures of the relative merit 
of the specimens is the assumption that the ratings given a 
specimen by a group of judges form a normal distnbution. On 
this assumption 50 per cent of the judges' ratings are above or 
at the median rating, and 50 per cent are below or at the median. 
If the same judges rate another specimen, and 25 per cent of 
them consider it as of less merit than the first specimen, whereas 
75 per cent consider it as of more merit, the lowest 25 per cent 
of the ratings of the second specimen fall below the median 
rating the first, and the next lowest 25 per cent are included 
between the median of the first and the median of the second. 

* William A McCall, How to Afeuvratn Ediwation (New York, Mao- 
g^lan po., 1922), pp. 272-291; also, “Proposed Uniform Method of 8ode 
DonstriiCtiOn,*’ Teachers College Record, Vol. 22, January, 1921, pp. Sl-fil. 

L. Thurstone, "Equally Often Noticed Differences,” Journal of 
lUmatkeui. Pspeholoin, Vol. 18, May, 1927, pp. 289-^. ■ 
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The baae-Une distanoe that includee 25 per cent of the eaaea 
in the normal distribution on one side of the median is the 
median deviation. Therefore the median value of the second 
specimen is IMdD * above that of the first if 75 per cent of the 
judges have rated it better and 25 per cent poorer than the 
first. Similarly, by the use of a table such as that in Appendix 
B, any given per cent of judges, except 100 or 0, can be trana* 
muted into an equivalent MdD distance. If it is desired, 9 
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PIG. 46 THREE NORMAL FREQUENCY CORVES REPRESENTING 
THE DISTRIBUTIONS OF JUDGES’ RATINGS OF THREE 
SPECIMENS OF WORK 

In this curve A repreeente the distribution of judgies’ for s 

qieoimen that 82 per cent of them rated as better than B, and curve B the 
distribution of ratings for a specimen that 75 per cent of the judges rated as 
better than C Therefore, as shown, specimen A u l.iTMdD better than B, 
and B I.OOAfdD better than C 

distances can be used instead, but the others are more commcmly 
employed. 

This procedure is illustrated by Figure 45 m which the carves 
A, B, and C represent the distributions of the scores ^veH by 
a number of judges to three specimens. In this case 82 pfer cent 
of the judges rated A above B, and 75 per cent, B above C. 

The distance between the median of A and that of B, there- 
fore, is about 1.37 MdD, found as follows. Since 82 per cent of 
the ratings given to specimen A are above the median rating 
of specimen B, it means that 82 per cent of the area of curve A 
is to the right of or above the median of curve B. Since 50 pw 
omit of the area of curve A is, of course, above its own median, 
this leaves 32 per cent that is between the medians of corves A 
and B. By consulting the second table in Appendix B, oile finds 
that the median-deviation distanoe corresponding to gn area 

* Id tiiis oounaetioQ Uie Dbbieviatioo PB to commonly but emncmiriy 
used iastead of MdlA 
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under the curve of .32 is approximately 1.37. This, therefore, 
is the distance between the medians of the two curves, or, in 
other words, the difference in difficulty between specimens A 
and B. Similarly it is found that the difference between the 
medians of B and C correspondmg to the fact that 75 per cent 
of the judges rated B as better than C is l.OOMdD. 

From the computations thus far made the relative diffi- 
culties or values are known, specimen A being 1.37AfdD better 
than specimen B, and B l.OOAfdD better than C. To deter- 
mine the absolute or final scale value of each it is necessary to 
know the value of some one of the specimens. This cannot be 
determined from the application of the method but must be 
arrived at in some other way. Sometimes it is done by taking 
the average opinion of the judges as to how far the poorest 
specimen is above zero, or no merit at all. Thus, for example, 
if C, the poorest of the three considered above, were considered 
to be 2.00AfdD better than zero its absolute scale value would 
be 2.00, that of B would be 2 00 -f 1.00 or 3.00, and that of A, 
3.00 + 1.37, or 4.37. 

Several points need to be noted in connection with the method 
just described. It has been assumed that more than 50 per cent 
of the judges rated each sample as better than the one with 
which it was being compared. If the per cent doing so is less 
than 50, all that is necessary is to reverse the direction of com- 
parison. In case all or none of the judges rank one specimen 
as better than another, it is impossible to tell how much the 
difference is. In applying this method it is necessary that all 
the judges rate a specimen as either better or worse than the 
one with which it is bemg compared. If judgments that the 
two specimens are equal are made they must be thrown out 
and only those used which pronounce one specimen better 
than the other. 

A practical question that arises in connection with the use 
of this method is that of how many judges are necessary to 
insure reliable ratings. Watson * has suggested that this may 

* Goodwin B. Watson, in the Journal of Edvcaltonal Rttearch, Vol. 18, 
Aptember, 1928, pp. 178-179. 
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be done by an application of the formula for the reliability of a 
proportion. From this formula we may rather easily compute 
the nximber of judges necessary to give any desired degree of 

X^'DQ 

reliability. It is that N must exceed (p — 50)^ ^ ^ 

equals the number of judges, p the per cent of judges believii^ 
one sample better than another, q the per cent believing it 
worse, and x the number of standard deviations that will give 
the desired degree of certainty. Watson recommends that for 
practical certainty 3<7 be taken. The formula then becomes 

N > If- however, possible to take any other 

value desired Table LXXV therefore gives the number of 
judges required to insure certain chances of reliability for each 
fifth per cent of judges rating one sample better than another 
from 55 up to 95, mclusive It shows that if one desires a chance 
of 739 to 1, which corresponds to 3ff, that the specimen rated 
better by the judges is really better than the one with which 
it was compared, at least 892 judges are required if only 56 per 
cent of them rate it better, 217 if 60 per cent rate it better, 
and so on, until finally only 3 judges are required if 95 per cent 
rate it better, and hkewise for chances correspondmg to 2.5«r 
and 2<7. 


TABLE LXXV 

NmiBERS or Jodges Necbssaby to Insuke Given Chances or 
RsiaABiLiTV or Ratings Accokwnq to Method or Eqx;ALi.T 
Noticed DirrERENCES 


Standard 

Errors 

Chances of 
ReUabUHy * 

Per Cent of Judges Rating One Specimen 
Better Than the Other 

66 

60 

65 

70 

75 

80 

85 

90 

95 

3.0 

739 

892 

217 

92 

48 

28 

17 

10 

6 

3 

2.5 

101 

619 

151 

64 

33 

19 

12 

7 

4 

2 

20 

43 

397 i 

97 ! 

41 

22 

13 

8 

5 ! 

3 

1 


* The chanoee given in this column are the chiuieei UuU the mnpite better bjr the 
Judges IS really better than the one with which it w eompared. 
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Exbbcihbs 


1. Change the following sets of data into normal distributions, and 
give the <r values of each. 

A. High 4, above average 16, average 28, below average 13, low 2. 

B. A 15, B 32, C 55, D 20, E 7, F 3. 

2. Compare the foUowmg distributions with the best fitting normal 
curves as shown in Table LXXV, and determine the chances that each 
difference is significant. Alsu determine P by the x* method for each 
distribution. 


A 


B 


S f 


120- 

1 

38- 

2 

110- 

2 

36- 

4 

lOO- 

6 

34- 

6 

90- 

14 

32- 

9 

80- 

32 

30- 

12 

70- 

49 

28- 

18 

60- 

35 

26- 

24 

50- 

13 

24- 

22 

40- 

7 

22- 

17 

30- 

1 

20- 

11 

20- 

1 

18- 

5 



16- 
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3. Draw the smooth frequency curve and the best fitting normal 
curve for each distribution given in Exercise 2 

4. Determine the per cents of pupils who should receive each of the 
given numbers of marks on the assumption of normal distribution. 

A. Four marks, with curve cut off at =*=2.5(7. 

B. Seven marks, with curve cut off at =*=4(7. 

5. Determine the difficulty values of test elements answered cor- 
rectly by 2, 18, 35, 60, 88, and 93 per cent of pupils. 

6. If specimen A has a value of 2MdD, and if 30 per cent of the judges 
rate B better than A, 91 per cent of them rate C better than B, and 84 
per cent rate D better thu C, what is the value of specimens B, C, and 
D7 



CHAPTER XXII 

MISCELLANEOUS 


Skewnes s. A measure of fikftwnfts p ni-bow far a 

di gtribution dep a rts f rom «■ Rvmmfttr iaal shape. Inasmuch as 
in a symmetrical distribution the mean, median, and mode 
coincide, the interval between some two of these may be used 
as a measure of the skewness of a distribution. To make such 
a measure of one distribution comparable with that of another 
it is necessary to express both in terms of a common unit. A 
measure of variability is such a unit. 

The most commonly used measure of skewness is Sk 

In other words, it is the distance between the mean 
<r 

and the mode divided by the standard deviation. As the true 
mode 18 usually difficult to determme, however, it is common 
to substitute for it an approximate value obtained from the 
formula Mo — 3Md — 2M. Making the substitution, the 
formula becomes 

Sk = - 2M) ^ 3(M - Md) 

a <x 


This is the usual form in which it is used. A positive result indi* 
cates that the mean is greater than the mode and the median, 
and a negative one, that it is less than either. Theoretically 
the formula has no absolute limit, but the result obtained from 
it does not exceed 1.00 unless the frequency distribution 
cemed is decidedly asymmetrical. 

Positive skewness is illustrated in Figure 46 and negative 
skewness in Figure 47. For the data represented in Figure 40, 


Sk 


3(10.68 - 10.36) ^ 22 
4.32 
m 
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and for those in Figure 47, 


Sk 


3(93.32 - 100.29) 
31.67 


-. 66 . 


These results show that the first curve is slightly positively 
skewed and the second decidedly negatively skewed. 

Another formula has been suggested and is fairly often used, 
although it is not so good as the one just given. Instead of 



Acootxlins to the formula baaed on the mean and the median, the skewneas 
of th»a curve ia .22. Accorduig to that mvolvuig the median and the quartUeo, 
it is .44. 

malritig a direct comparison of two measures of central tend- 
ency, this formula compares two base-line distances. These 
are the distances froot the first quartile to the median and 
from the median to the third quartile. The quartile deviatum 
fr used as the unit, so that 

Ct. _ (Q. -Md}- (Md - Oi) 

Q 

which becomes 

Qt 



MISCELLANBOUS 


Aooordii^ to this formula skewness cannot exceed ^ 2.00, and 
rarely exceeds ^ 1.00. If its value is positive it means that the 
distance from the median on to the third quartile is greats 
than that from the first quartile up to the median or, in other 
words, that there is a greater pihng up of measures below than 



AooordinR to the formula based on the mean and the median, the akewosM 
of thia curve is — .66 According to that involving the median and the quartilaa, 
it is - .44. 


above the median. Since the piling up is greater below, the 
curve must be drawn out further above. Thus positive and 
negative skewness, according to this formula, have the same 
general meaning as according to the previous one. This fonnula 
appears not to be so sensitive to small differences in the idiape 
of the distribution as is the preceding one. For the data uflad 
in Figures 46 and 47 it gives. 


Sk = 


13.44 + 7.69 - 2 10.36 14 

2.88 ■ ’ 

117.38 + 73.61 - 210a,y 
21.89 


— .44, respectively. 
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Stall another formula for measuring skewness has been sag* 
gested by Kelley.' It is 


Sfc = Md - — - • 


This is constructed on much the same principle as the one 
that involves the median and quartiles. In this case, however, 
a positive skewness, according to this formula, denotes a 
drawing-out to the left, and a negative skewness, one to the 
right. For the data employed in Figure 46 this formula gives 


Sk = 10.36 - 


5.16 + 16.63 
2 


-.54. 


For those in Figure 47 it yields 


100.29 


45 + 129 
2 


13 . 29 . 


This formula does not appear so satisfactory as the other two 
for two or three reasons. Probably the most important is that 
the signs of the results obtamed are just the reverse of those 
Qommonly used in describing skewness. A second is that it 
does not provide for dividing the absolute skewness by such a 
quantity that the result is a measure of relative skewness. 
Hence it cannot readily be used in comparing two distnbutions 
unless they are upon the same scale. A possible third reason 
is that it has not yet come into nearly so common use as the 
other formulffi. 

Kurtosis. The kurtosis of a distribution or figure refers to the 
degm^to which the measures are grouped around the average 
words, to its steepness. Comparatively few workers 
statistics have dealt with this chaiacteiistic of 
and the only common measure of kurtosis is that sug- 
^gssted by Kelley,* the quartile deviation divided by the 10- 90 

percentile range, that is, Ku = The application of this for- 


>Tnnaso L. Kelley, StaUtixcal M 0 lhod (New York, Macmillan Co., 
1«23), p. 77. 

* KeUey, loc. eit. 
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mula may be illustrated the two examples used in the previ- 
ous section of this chapter. For the first, 


2.88 

16.63 - 5.16 


and for the second, 


K,. - 21.88 _ 

^ 129. - 45. 


The value yielded by this formula may range from .00, which 
indicates that all the cases between the first and third quartiles 
are bunched at a single point on the scale, to 1.00, which indi- 
eates that all those between the tenth and ninetieth percentiles 
are bunched within the same limits as are those between the 
first and third quartiles, or, in other words, that the cases be- 
tween the tenth percentile and the first quartile are all at the 
first quartile, and those between the third quartile and the 
ninetieth percentile all at the third quartile. 

If a distribution is normal, or mesokurtic, this measure of 
kurtosis is approximately .2632. If Ku is greater than .2632 
the distribution to which it applies is flatter than normal, or 
platykurtic, and if Ku less than .2632 the curve is steeper 
than normal, or Icptokurtic. 

Overiapping. Although it is possible to compare two dis- 
tributions by merely stating the same measure of central tend- 
ency for the two, such a comparison is often not very satis- 
factory. It shows only in a very general way which one of the 
two distributions tends to be oomposed of the larger or higher 
measures. The spread of the two distributions may be very 
different. For example, one may desire to compare 
of which one has a mean school mark of 90 and the ot3»j^B||L 
It is evident that if other things are equal the first claimi|H 
whole is doing the better work. The means alone, however, mr 
not indicate how many of the pupils in the first class are doin^ 
better wodk than those in the second. The marks made by the 
iBrst group may range only from 85 to 95, whereas ibose made 
by the second group may vary from 70 to 100. If this ip the 
case the second class contains some pupils making better marks 
and others making worse marks than any in the first class. If 
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those in the second class have marks ranging only from 80 to 
90, however, none of them rises above the mean of the first class. 

To provide an adequate means of comparison in such situa- 
tions some measure of overlapping must be used. That is, 
there must be a measure of how many or what proportion of 
cases in one distribution exceed a certain point in the other 
distribution. The most usual measure of overlappmg is the 
per cent of cases in one distribution which reach or exceed the 
median of the other. Other pomts than the median may be 
used, of which the first and third quartiles are probably the 
most common. However, if the per cent of overlappmg is stated 
without any further explanation it should be understood that 
it is based upon the median 

To illustrate the computation of the per cent of overlapping 
the marks of two classes, A and B, may be taken. 
The median mark of Class A equals 

^-15 

80 + ^ — 5 = 81.43. 

Therefore to find the per cent of overlapping of 
Class B on Class A it is necessary to find the per 
cent of marks in Class B that exceed 81 43 It is 
evident that the rune (1 + 3 -H 5) m or above the 
86- group and some of those m the 89- group exceed 81.43. 
As the distance from 81.43 to the upper limit of the 89- group 
is 3.67, or ^ of 5, the class interval, it is most likely that f of 
the six cases in this class are above 81.43. Therefore to 9 should 
be added 4f, which is ^ of six, making a total of 13f marks 
frran Class B which overlap the median mark of Class A. Ex- 
pressing this in terms of per cent, it equals about 37 per cent 
(13f -i- 36), which is the overlapping of Class B upon Class A. 

In a similar manner the overlapping of Class A upon Class B 
ma,j be found. The median of Class B equals 


Mark A B 

95 - 2 1 

90 - 4 3 

85 - 6 5 

80 - 7 6 

75 - 6 8 

70 - 5 7 

65 - 3 4 

60 - _2 
34 36 


75 - 1 - 


36 


- 13 


78.13. 


8 
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All the marks of Class A in the 80- group or above and | of 
those in the 75- group exceed this median. Thus the total num- 
ber in Class A exceeding the Class B median is 21f, the sum 
of2 + 4 + 0 + 7 + |of6. Since the total number of cases 
in Class A is 34, the per cent of overlapping is 21i 34 = 62J 

per cent. 

The overlapping just computed for the given data is illus- 
trated graphically in Figure 48. The two curves in this figure 



no. 48 ILLUSTRATION OF OVERLAPPING OF EACH DISTRIBU- 
TION PAST THE MEDIAN OF THE OTHER DISTRIBUTION 

Approximately 37 p«r cent of distribution B overlaps the median of distribu 
UoD A. and 62 1 per cent of A overlaps the median of B. 


represent the distributions of the scores of the two classes. 
The area under Curve B, which lies to the right of the median 
of Curve A, represents the overlapping of B on A and is, as has 
been computed, about 37 per cent of total area under B. 
Similarly, that portion of the area under A to the n^t of the 
median of B represents its overlapping and amounts to ^ 
per cent of the whole area under A. 

Although this is the most common method of measuring 
overlapping there are others that may be employed. The 
simplest is merely to take the difference between si milar meas- 
ures of central tendency. This difference may then be divided 
by the standard deviation or some other measure of variability 
so as to give a relative rather than an absolute measure ov^ 
lapping. Another possible method is by the use of the bi-eerial 
coefficient of correlation between the two distiibutioiis. A good 
discussion and cennparison of these three possible methods has 
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been given by Symonds.* Hie oonclosion is that bi-swial r 
diould be lued for this purpose more frequently than at present. 
It represents a common unit of measurement that may be 
ployed to compare differences between groups when different 
tests are used. His article contains a senes of graphs represent- 
ing the overlapping corresponding to various values of bi- 
serial T and also several tables of probabilities corresponding 
to the same values that are quite helpful in their interpretation. 

Comparison and measurement of change. When dealing with 
educational data one sometimes wishes to measure the change 
in certain mdividuals or groups. In many cases so domg is not 
essentially different from measuring the differences between 
individuals or groups. There are, however, certam pomts hav- 
ing to do with the measurement of change, which seem worth 
presenting here. 

Two of the possible ways of measuring change are most impor- 
tant : by means of the absolute amount of change and by means of 
the proportion or ratio of change. For example, if an individual 
makes a mark of 80 at one time and of 88 at another the change 
may be described either as a gam of eight points or as a gain of 
Ono-tenth. Neither method of describing it is complete. 

Another method anses from the fact that a change of a cer- 
tain amount or proportion at one point on a scale may not, 
from one point of view, be equal to a change of the same size 
occurring at another point on the scale. For example it is 
generally more difficult for a pupil to raise a mark of 98 per cent 
to 99 per cent than it is for one to raise 74 per cent to 75 per 
cent. Therefore, an absolute change of 1 per cent does not mean 
^e same thing in the two situations, since it cannot be made 
with the same amount of improvement in work. The same 
statement may also be made of a proportional change, since 
from 74 to 75 is whereas that from 98 to 90 is smaller, being 
only 1 ^. Therefore the fact that the latter is more diffi^t to 
iIttdEe is even more at variance with the statement of propoi^ 

*PMfofval M. Symonds, “A Comparison of Statutioal Measuns M 
with Charts for Estimabng the Value of Bi-Serial r,*' Jem- 
P$yeholouy, Vol. 21, November, 1930, pp. 586-506. 
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tk>nal change than with that of absolute change. It has been 
suggested that the best way to ccunpare such changes is to find 
the ratio of the change to the possible change, that is, the ratio 

the change to the distance from the original measure to the 
highest possible score. Thus a change or gain of from 74 to 75 
may be called a gain of since the distance from 74 to 100 is 
26, and one of from 98 to 99 may be called a gam of as the 
distance from 98 to 100 is 2. Such a manner of comparing 
changes is, however, for many purposes decidedly misleading. 
It is probably not usually thirteen tunes as difficult to raise 
one’s mark from 98 to 99 as from 74 to 75. 

The chief point to be remembered from the foregoing discus- 
sion is that the manner of computing and stating changes should 
be suited to the purpose for which they are being used and the 
general meaning of the data involved. Sometimes one and some- 
times another of the methods mentioned is the best to use, and 
sometimes no one of those pven should be used alone, but sev- 
eral (or some other more complicated ones) should be employed. 

Two things may be meant by the change in a group. It may 
refer either to the change undergone by the group as a whole, 
as expressed usually by some measure of central tendency, 
variability, etc., or to the changes undergone by the variouB 
individuals of the group. A measure of the first yields an ex- 
pression that shows merely general group tendency, whereas a 
measure of the latter yields one showing the consistency of the 
individuals within the group For example, the increases in 
ability to add due to a ten-minute practice period each day for 
a week for a class of forty children are not the same as the in- 
crease from the average ability of the group at the beginning of 
the practice period to that at its end. The former consist of 
forty individual changes, whereas the latter is merely cme 
single numerical expression, which to some extent summar 
rises these changes. 

Equivalent of comparable measures.* It frequently oceoiV' 
that one desires to render the measures in two or more qaries 

* The reader who is particularly interested in this toi^ sfawld also sea 
Triiman L. Kelley, op. c*t., Ch. n. 
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ocHnparable with one another or to express them in equiva* 
lent terms, although originally they have been measured upon 
entirely different scales and in different units. For example, 
one may give several different standardized tests in readmg 
and wish to change all the scores to a common basis so as 
to facilitate comparison, averaging, or something else. To 
give a second example, several tests of different types and 
with different scoring systems may be given by a teacher 
and she may wish to compare or combine the scores made 
thereon. 

To make such a comparison or combination the scores in- 
volved should be expressed on eqmvalent scales and m equiva- 
lent units. Any method of doing this should satisfy the condi- 
tions that two pomts of one scale must be known to be equal 
respectively to two pomts of the other and that the law 
governing the relationship between successive pomts on one 
must be known to be the same as that govemmg it for the 
other. These conditions, especially the latter, are rarely ful- 
filled. Several methods for obtaining comparable or equiva^ 
lent scores are m more-or-less common use and will be ex- 
plained m this section. All mvolve one or more assumptions 
not always fully justified, so that no one of them is entirely 
satisfactory. 

From the statistical standpoint the best proposed method for 
obtaining comparable scores is the standard-measures method 
ised by Kelley and others. It yields scores similar to those 
obtained by the use of the equivalent-score equations explained 
in Chapter XIII, except that instead of the measures of one or 
more series being expressed m terms of those of another series, 
all are expressed in terms of a standard series. The scores ob- 
tained by this method are frequently denominated by the letter 


z, and are given by the formula z = or -• Putting this 

O’ O’ 

in woTda merely means that a e-BOore, or standard measure, is 
4iie difference between the original score and the mean of its 
sra^ies divided by the standard deviation of the series. Since 
ithese scores are expressed in standard-deviation units, they are 
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frequently called <t scores.* Also Z is sometimes employed as 

equal to — • 

<r 

Standard measure or a scores are based upon three assump- 
tions: (1) that mean scores are comparable, (2) that standard 
deviations are comparable, and (3) that therefore equal stan- 
dard measures are comparable. Of these the first appears to be 
generally true, and the second holds frequently enough for 
practical purposes. Therefore the third may be considered as a 
working basis that usually gives quite satisfactory results. 

Another method sometimes used, but less often valid, is the 
ratio method. This is based upon the assumptions that- (1) the 
zero pomts upon the two scales are equal, that is, that they 
represent the same amounts of the two things being measured; 
(2) some other point, usually the mean, on one scale is equal to 
the correspondmg point on the other scale; (3) the law of de- 
velopment of the two things bemg measured is the same. In- 
stead of the means, any two points may be used if they are 
comparable m the sense of representing correspondmg amounts 
of the two thmgs being measured. To render scores in the two 
series comparable they are then expressed as fractions, usually 
per cents, of the means or other pomts used instead of the 


means. 


The formula for a ratio score is simply — , in which B stands 

iS 


for the base used m determinmg ratios. Smee this is usually the 
mean, the formula generally becomes -r^. If a group has a mean 


spelling mark of 80 per cent and a mean I.Q. of 100, compa- 
rable ratio scores may be obtained by dividing each pupil's 
spelling mark by 80 and his I.Q. by 100. For example, if a pupil’s 
spelling mark is 90 and his I.Q., 105 the ratio scores equivalent 

to these measures are ^ = 1.12^ and ^ = 1.05. A compari- 


* In connection with a index or t scores it seems wdl to mention that 
the well known T-eoore, suggested by McCall, is a score this type. It 

is obtained by the formula 50 + ^ • 
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Km of these mai%33 indicates that the pupil in question ranks 
better in spelling than in I.Q. To give a second example, a 
pupil whose spelling mark is 60 and whose I.Q. is 85 has ratio 
60 SS 

scores of ^ = .75 and = .85, respectively, hence ranks .10 


hi^er in intelligence than in ability to spell. 

The chief reason why this method of procedure is often faulty 
is that the third assumption, that the laws of development of 
the two variables are the same, is often not valid. Using the 
example of spelling marks and mtelhgence quotients just given 
it will be seen that a spelling mark of 100 per cent, which is 
the maximum possible, is equivalent to an intelligence quotient 
of 125,* yet in an unselected group of 40 or more children it is 
probable that at least one will be found whose intelligence quo- 
tient is above 125. For such a pupil there can be no strictly 
0 (»nparable measure in spellmg according to the assumptions 
made. Likewise, at the other end of the series we know that a 
pupil whose I.Q. is 20, for example, will m all probability scarcely 
be able to spell the easiest word correctly, yet the spelling mark 


20 

equivalent to an I.Q. of 20 is 16, since ^ 

lUU 


which implies 
oO 


that such a pupil should spell correctly 16 per cent of the words 
attempted. It is therefore evident that although this method 
may be used, care should be taken to make sure that the assump- 
tions underlying it are at least approximately true. 

The appropriateness of the base used in the method may be 
judged by the criterion that the ratio of the base to the stand- 
ard deviation of one series of measures should equal the cor* 
leqa^lpding ratio for the other series. If this condition does not 
hoidj approximately the scores resulting from the use of the 
giydh base carmot be considered valid for purposes of oompari- 
aoti. Sometimes enough is known concerning the traits measured 
tfai|t instead of a similar law of development for the two oe man 
•tries involved, differmt but definite laws can be assumed. 

A -generaUy better method of finding equivalent scores UuUk 

'Tidl |i45und by serving ^ which gives 126. 
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tile last, is that of oonsidering corresponding percentiles as being 
equivalent. That is, for example, a score at the 10th percentile 
of the distribution of spelling marks is considered equivalent 
to a score at the 10th percentile of the distribution of I-Q-’s, a 
score at the 35th percentile to one at the 35th percentile, and 
BO forth. All that one needs to do to employ this method is to 
prepare a table showing the percentile points of the two dis- 
tributions and then look up the scores to be compared therein. 
Any difference in the equivalent percentile scores at once indi- 
cates a difference in the relative rankings of the original scores. 

The two chief objections to this method of equating scores 
are that one cannot get a definite equation to connect the two 
series and that one or a few unusual scores in a group may 
affect the equivalent scores too largely. The first objection may 
be answered by the fact that very commonly one has no use for 
such equations and the second avoided either by using series 
containing large enough numbers of cases so that the chances of 
their being greatly affected by a few unusual ones are very 
small or by smoothing the equivalent scores. 

If one is dealing with two or more series of measures, each 
which contains the same number of cases, it is for most purposes 
just as satisfactory to use ranks as to employ percentiles. If 
this is done all that is necessary is to arrange the scores in each 
series in order and assign corresponding ranks. This method is 
open to the same objections as the percentile method. 

Another method sometimes employed for computing ocan- 
parable scores is to assume that each distribution is normal and 
to assign to each group of scores the equivalent value deteav 
mined as described on pages 378 to 382. Since such equivfj|i»it 
values are ordinarily expressed in terms of the standard de4!»- 
ticHi, they are sometimes called a indices or standard measuns 
even though they are not derived in the same manner as tine 
standard measures described earlier in this section. Moreover, 
their meaning is not the same since the assumption of a ncmnal 
distribution is made. Therefore, this metiiod is a|^nopiriate 
only in the case of distributions witii non-numeriod dbases, 
dbw if the classes are numerical or quantitative the shape of 
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TABLE LXXVI 

Computation or Compakablb Meabobks bt DirramiNT Mbtbodb xm 
Cask or Sikpla Sbribs 


Ortginal 
Senet * 

Standard 
Meatures t 

Raltoa 

PercerdtUe 

Rank* 

X 

D 


** 

X 

M, 

Y 

My 

D 

D 

X 

Y 

98 

25 

+1 73 

+ 1 16 

1 15 

1 18 

97 5 

900 

20. 

18.5 

96 

25 

+ 1.47 

+ 1 16 

1 13 

1 18 

92 5 

900 

19. 

18.5 

95 

25 

+ 1 34 

+ 1 16 

1 12 

1 18 

87 5 

90.0 

18 

18.5 

94 

25 

+ 1 21 

+ 1 16 

1 11 

1 18 


900 

17. 

18.5 

92 

24 

+ .94 

+ 

.87 

108 

1 14 


75.0 

16. 

15.5 

90 

24 

+ 68 

+ 

.87 

106 

1 14 


76.0 

14.5 

15.5 

90 

23 

+ 68 

+ 

.57 

106 



600 

14.5 

12.6 

87 

23 

+ 28 

+ 

57 

103 

109 

62 5 

60.0 

13. 

12.5 

86 

23 

+ .02 

+ 

57 

1.00 

1 09 

57 5 

600 

12 

12.5 

84 

23 

- .11 

+ 

57 

99 

1 09 

500 

600 

10.5 

12.5 

84 

22 

- .11 

+ 

27 

.99 

104 

500 

47 5 

10 5 

10. 

82 

21 

- .37 

— 

03 

97 

1.00 

37.5 

42.5 

8. 

9. 

82 

19 

- .37 

— 

63 

97 

.90 

37 5 

35.0 

8. 

7.6 

82 

19 

- .37 

— 

63 

97 

.90 

37.5 

35.0 

8. 

7.6 

80 

18 

- .64 

— 

93 

94 

.85 

275 

225 

6 

6. 

79 

18 

- 77 

— 

93 

93 

85 

226 

22.5 

5 

6. 

77 

18 

-1.03 

— 

93 

91 

85 

17 5 

22.6 

4 

6. 

76 

17 

-1.16 

— 

1 22 

.90 

.81 

12 5 

12.5 

3 

3. 

73 

16 

-1.66 

— 

1 52 

86 

.76 

7.5 

75 

2 

2. 

71 

14 

-1 82 

- 

2 12 

84 

.66 

2.5 

25 

1. 

1. 


• Jf, - 84 85. Af, - 21 10, - 7 68, - 3 36 


the distnbution is already determined and should not be al- 
tered. 

To illustrate various methods of securing comparable scores 
tBtire clearly Tables LXXVI and LXXVII have been included. 
The hist contains two series of OTiginal scores upon diff^nt 
ioi^, and following these the equivalent or comparable scores 
l^ecordhig to each of the several methods described in this seo- 
tkm. The first two oohimns in this table contain two ungrouped 
feriM of ocigjnai sctaes denominated X and Y. The next two 
^Bontain tlie i^andard-measure scores found by the formula 
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idready given for this purpose. Since the means of the original 
series are 84.86 and 21.10, respectively, and the standard de- 
viations, 7.58 and 3.35, these formuhe become in this case: 


Zz 


X - 84.85 
7 58 


and = 


Y - 21.10 
3.35 


Substituting in these the various scores in the original series, 
we obtam the standard measures given m Table LXXVI. 


Thus for the first X score, 98, the z score = 


98 - 84.85 
7.58 


= +1.73; for the next, 96, the z score is +1.47 ; and so on. The 
next pair of columns contains the ratio scores found by dividing 
each origmal score by the mean of its senes. Thus 98 dmded by 
84.85 gives 1 15, the first ratio score m the X column. The fourth 
pair of columns contams the percentile scores or ranks found 
by the method descnbed m Chapter VI. Finally, the last pair 
of columns contains the simple ranks of the scores ranging from 
1 to 20, since there are twenty cases. 

Inspection of the table shows that the interpretation of the 
various onginal pairs of scores differs according to which com- 
parable measure is used. Thus, by the standard-measure 
method an onginal X score of 98 appears to be about half again 
as large relatively as does a Y score of 25, smce Zx in this case 
equals 1.73, and Zy equals 1.16. According to the ratio scores, 
however, the 1' score, 1 18, is slightly larger than the X score, 
1.15. When percentiles and ranks are considered, the X score 
in question agam appears to be relatively higher than that 
of Y. A somewhat different situation is illustrated by an A score 
of 87 and a Y score of 23. according to both the standardr- 
measure and the ratio methods the equivalent Y score is larger 
than that of X, but by the percentile and rank methods |he 
reverse is true.' 

The next table. Number LXXVII,. is similar to Table 


> The reader should note that since the percentile and the rank methods 
sra in reality two ways of expressing the same ihing, differait imits bdhK 
used, they always agree as to which one of any pair or group of soores it 
the greater or the smaller. 
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LXXVI, but deals with frequency distributions nth«r than 
simple series. The only difference in the working out of the 
various comparable measures giv^ therein is that, as is corn* 
mon with frequency distributions, all of the cases in each class 

TABLE LXXVn 

COUFUTATION OF COMPARABLE MbaSORES BT DIFFERENT METHODS IN 

Case of Frequency Distributions 


Ongimd 

Dtstnbutuma 

• 

Stamiard 
Measures f 

Ratios 

Percentiles 

Ranks 




■n 


D 






X 

Y 


B 





r 

X 

Y 

f 


/ 









2100- 4 

26- 

1 

+2 12 

+2 37 

1.30 

2.31 

97.8 

EIXI 

885 

Km 

2000- 3 

24- 

2 

+ 169 

+2 06 

1 24 

2.14 

93 9 

97 8 

85. 

88.5 

lOOO- 6 

22- 

3 

+ 1.26 

+ 1 75 

1 18 

1 97 

89.4 


81 

86 

1800- 16 

20- 

6 

+ 84 

+ 144 

1 12 

1 80 

77 8 


70 5 

81.5 

1700- fl 

18- 

6 

+ .41 

+ 1.13 

106 

1 63 

639 

83.3 

58. 

75.5 

1800- 10 

16- 

5 

- .02 

+ 82 

1 00 

1 46 

53.3 

77.2 

48.5 

70. 

1600- 24 

14- 

7 

- .45 

+ 51 

.94 

1 29 

34 4 

70 6 

31.6 

64. 

1400- 5 

12- 

0 

- .87 

+ 21 

.88 

1 11 

18.3 

61 7 

17. 

56. 

1800- 6 

10- 11 

-1.30 

- 10 

82 

94 

12.2 


115 

46. 

1200- 8 

8- 

15 

-1.73 

- .41 

.76 

.77 

4.4 


45 

33. 

AT - 90 

6- 

8 


- 72 


60 


23 3 


21.S 


4- 

5 


-1 03 


43 


16.1 


16. 


2r- 

4 


-134 


.26 


11.1 


10.5 


0- 

8 


-1 65 


.09 


4.4 


4.5 


N - 

90 










• Jf, - ISM 44, My - n.67, - 233 78, .y - 8.48. 

Z- 10*4 44 r-1167 

' ** " 233.78 •*»" 8.48 


are assumed to be at its mid-point. Probably the most notice- 
able feature of this table is the difference in the sizes of the ratio 
scores for the two distributions. For the first their range is 
quite limited, being only from .76 to 1.30, whereas for the second 
distribution Ibey range from .00 to 2.31, or over four times as 
far. Furthermore, when the standard measure and the ratto 
icores of the largest measures in the two series are compared it 
it sem tittt those of the 8e(»nd or Y series are the greater, 
lidtSMS the reverse is true for the percentile and rank soorea. 
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the oaae of the smallest scores the X ratios are modi greater 
tium those for Y, whereas the other comparable scores show 
littie or no difference. 

It not infrequently occurs that one wishes to find the stand- 
ard measure and ratio scores equivalent to single measures 
when the standard-measure equation and the ratio have been 
determined from group measures. The procedure is exactly the 
same as that indicated in the table. For example, if one wishes 
to find the standard measure corresponding to an X bcch« of 
1525, the result is: 

_ 1525 - 1654.44 _ ,, 

' — .Oo* 

233.78 

The corresponding ratio score is found by dividing 1525 by the 
mean, 1654.44, which gives .92. 

The comment should probably be made that although the 
two distributions in each table have the same number of cases, 
this IS not at all necessary but merely accidental. Indeed, in 
many instances one wishes to find the score of an individual in 
a group of a certam size that is comparable to either the same 
or some other individual’s score in a group of quite different 
size. 

If one wishes to compare the proportions of two or more di»- 
tributions falling above, below, or between certain limits, the 
simplest and most satisfactory way of doing so is mere^ to 
change the frequencies mto per cents so that those in each 
distribution total 100 per cent. If one desires to make the com- 
parison by means of graphs these distributions in terms of per 
cents may then be graphed and, since the areas of the whole 
figures are the same, it is easy to compare the relative areas of 
similar parts thereof. 

Curve-fitting. Although the topic of curve-fitting receives 
considerable treatment in some texts on statistics, the ordinary 
educational worker has so little occasion to do more in th^ 
respect than to determine the best normal curve, as eiqilaine^ 
in a section of the previous chapter, that nothing furUier wifl 
be included here. The reader who is interested is refmted to 
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other sources, specially the treatments by Hobsinger* and 
KeUey.» 


Exercises 


1. Determine the first two 

measures 

of skewness for 

distributions given below. 



A 

B 

C 

/ 

/ 

/ 

95- 2 

13- 1 

1075- 2 

90- 3 

12- 1 

1050- 5 

85- 6 

11- 0 

1025- 9 

80- 7 

10- 2 

1000- 16 

75- 12 

9- 3 

975- 24 

70- 15 

8- 1 

950- 21 

65- 11 

7- 4 

925- 17 

60- 8 

6- 6 

900- 13 

55- 3 

5- 5 

875- 8 

50- 1 

4- 9 

850- 3 

45- 0 

3- 6 

825- 1 

40- 1 

2- 2 

800- 2 


1- 1 



0- 4 



2. Determine the measure of kurtosis of each of the distributions 
given in Exercise 1 . 

3. Find the per cent of overlapping of each distribution above the 
median of the other one groupied with it. 


A 

/. 

/. 


B 

/. 

/. 

95- 2 

4 

24- 

1 

0 

90- 3 

5 

22- 

3 

2 

85- 4 

7 

20- 

4 

5 

80- 6 

10 

18- 

6 

5 

75- 8 

10 

16- 

11 

8 

70- 5 

8 

14- 

17 

14 

65- 2 

3 

12- 

16 

10 

60- 1 

0 

10- 

14 

9 


' Karl J. Hokinger, StatuhecU MeUutdtfor Students in EduccMtm (Boston, 
Oinn & Co., 1928), xvi, "The Elen^ts of Curve-Fitting.” 

• Truman h. Kelley, Statistical Method (New York, Macmillan Co., 
1023), C3t. vii, “The Siting of CHirvee to DistnbutionB.” 
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A {coni.) B (cent.) 

65- 1 1 8-86 

5ft- 1 0 6-7 3 

4-2 0 

2- 3 1 

0 - 1 1 

4. Determine the equivalent or comparable measures by the four 
methods illustrated m Tables LXXVI and LXXVII for each of the 
scores in Parts A and B and for each class m Parts C and D. 



A 

B 



C 



D 







/. 

/. 


/ 

/ 

10 

110 

44 

11 

90- 

6 

4 

125- 

2 

48- 1 

18 

115 

42 

12 

80- 

15 

8 

120- 

0 

46- 2 

18 

102 

41 

10 

7ft- 23 

13 

115- 

4 

44- 3 

17 

98 

39 

9 

60- 42 

21 

110- 

5 

42- 5 

16 

101 

39 

7 

50- 31 

28 

105- 

8 

40- 7 

16 

91 

38 

10 

4ft- 

17 

35 

100- 

9 

38- 6 

15 

88 

38 

9 

3ft- 

11 

22 

95- 

11 

30- 3 

14 

89 

38 

8 

2ft- 

9 

14 

90- 

6 

34- 4 

14 

85 

37 

9 

1ft- 

4 

9 

85- 

2 

32- 3 

14 

74 

36 

9 

0- 

2 

6 

80- 

1 

30- 2 

13 

90 

36 

6 




75- 

1 

28- 1 

13 

77 

35 

8 




70- 

1 

26- 2 

11 

75 

33 

6 






24- 1 

10 

68 

31 

7 







0 

72 

30 

6 







8 

71 

30 

4 







8 

62 

27 

5 







6 

61 

24 

2 







4 

54 









3 

37 










5. A. Prom the results obtamed in Part C of Exercise 4 detennine 
in which senes of scores individuals who have the following soons 
rank higher. Use all methods, a 88, 86; b. 72, 68; c. 54, 57; d. 22, 8. 

B. Do the same for the following scores from Part D. a. 117, 46; 
b. 110, 40, c. 98, 36; d. 87. 39. 



CHAPTER XXIII 

THE GRAPHIC PRESENTATION OF FACTS 

Introduction. To give anything approaching a complete 
treatment of the subject indicated by the title of this chapter 
would require a whole volume rather than a chapter. It is the 
writer’s purpose merely to state briefly the more important 
rules and principles that should be followed m the graphic pres- 
entation of facts and to illustrate some of the most frequently 
usable forms of graphs. In choosing the principles and forms 
to be given he has had in mind particularly the needs of ad- 
ministrators for presenting facts to school boards and the gen- 
eral public, and, to a somewhat lesser degree, of supervisors 
for presenting facts to teachers, and of teachers for presenting 
facts to pupils. 

Before proceeding further it seems well to refer to a few of the 
most helpful discussions of this topic so that readers who wish 
to do so can familiarize themselves with it more thoroughly 
than is possible from this chapter alone. McCall ' and Rugg * 
present good treatments of about the same scope as that given 
here. Alexander * gives somewhat more space to the topic and 
offers quite a number of valuable suggestions for presenting facta 
to the public. The most complete treatment of the subject, 
from the standpoint of education alone, is that of Williams, * 
who devotes a volume of more than three hundred pages to it. 
He includes over a hundred different graphs with comments 

• William A. MeCall, How to if ensure tn Education (New York, Macmil- 
lan Co., 1022), Ch. xiu, “Graphic Methods.” 

* Hai^d Rugg, A Primer of Graphics and Stalisttcs Jar Teachers (Boetwi, 
Houston Mifflin Co., 102S), Ch. viii, “How Can the Teacher Use Qraphio 
and Statistical Methods?” 

. '‘Oerter Alexander, School SuUtsHce and PubhcUy (Boston, ffilmr, 
Ihtniett A Co., 1010), Ch. aa, “Graphic IVeeentations of Sohocd StatisUee 
iBveoiatly for the PobUe.” 

• ^ Hitfoid WilHams, Oraphtc MdOsods in Education (Boston, Houghton 
Ifflfflin Co., 1924), 310 pp. 
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aa to 4iie good and bad points of each and the suitable and un- 
suitable occasions for employing them. Also he has a cluster 
devoted to elementary instruction in the use of drawing mate- 
rials and instruments and the proper methods of drawing. 
Probably the best known treatment of the subject is that of 
Brinton,* who deals with the subject from the general mathe- 
matical standpoint. He includes a set of rules adopted by a 
committee representing seventeen scientific societies of whidl 
he was chairman, and L. P. Ayres secretary. A much larger 
book, also written from the general mathematical viewpoint, 
is that of Karsten.* Anyone who wishes to become thoroughly 
familiar with the subject should certainly consult it. 

General principles. Graphs should be readily understandable. 
To accomplish this they must possess a considerable degree of 
simplicity. They should not contain too many elements or be 
otherwise too complex. If a number of different sets of data is 
to be represented, it is ordinarily best to use several graphs for 
the purpose and not to attempt to represent all of them upon 
one. Also as little verbal explanation as possible should be 
needed to make their meaning clear. 

Not only should a figure require a minimum of verbal ex- 
planation to make it intelligible, but whatever is necessary fmr 
this purpose should directly accompany the figure itself — the 
title and the lettering, or wording, on the graph should explain 
it fully enough that no reference to the text is necessaiy. The 
text should usually contam further explanations and inter- 
pretations than are given on the figure itself, but everything 
necessary to understand its essential meaning should immedi- 
ately accompany it. The data represented by a graph should be 
given directly on it or in an accompanying table. For example, 
if a figure contains a line representing a curve for which tba' 
equation is known it is frequently desirable to write this equa- 
tion upon or along the line. To give a second example, if a 

't 

• W. C. Brinton, Oraphtc MMhodt for Preoenttng Facts (New Yoric, Thg 
Engineering Magaidne, 371 pp. 

* Karl G. Kanten, CharH and Ordpks (New York, Prentioe-Hall, Ids., 
1928), 724 pp, 
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figure contains a number of Iraxs representing different quantities 
or amounts, figures may well be placed on or accompanying 
each to show how much it represents. 

The conventional place for the title is below the figure and 
the accepted practice is to number graphs or figures with Arabic 
numerals. The general arrangement of graphs should be from 
left to right and from bottom to top. Labels and figures indi- 
cating the data represented and the amounts thereof are com- 
monly placed at the bottom and left or along the axes. 

The size of a graph should be such that it is easily readable 
at the distance from which it will commonly be seen, but not so 
large as to require that the head be turned to see all of it at 
once. In the case of pnnted and typed matenal, graphs should 
rarely exceed one page m size. Only in cases of necessity should 
folded inserts be used. Not only is it important that the size 
of the graph as a whole be large enough to be easily readable, 
but the letters, words, and numbers upon it should also con- 
form with this requirement. There should be no necessity for 
the reader to bring the figure to withm a few mches of his eyes 
in order to interpret it. 

The background of a figure should not be prominent. If the 
figure is drawn upon ruled paper the lines that are not in them- 
selves important should be quite light and no more in number 
than are necessary. If ruled paper is not employed it is fre- 
quently desirable to draw the necessary gmdmg lines lightly 
with a soft pencil and then erase them after the permanent 
portion of the work has been put in with a bard pencil or in ink, 

A graph should present forcefully but without exaggeration 
the facts it is designed to portray. Perhaps the most common 
violation of this principle consists of taking facts out of their 
context and presenting them m isolation so that they do not 
give a true picture of the total situation. The scales used, how- 
esqer, are also important m this connection. No definite rule 
can be given as to the relation of the vertical and horizontal 
■cAles to «ich other. It should be such as to reveal significant 
^eaeeae^ or changes, neitlipr minimizing them nor unduly 
cpcaggarating tbem> In most cases this is accomplished fairly 
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if the total height of the graph is not greater than its width, 
nor less than half its width. 

In the case of graphs to be presented to those not familiar with 
the principles of graphic representation, and this includes most 
persons, it is usually desirable to show the zero lines and also, 
if possible, all space from them to the location of the actual 
data nearest to zero. Sometimes the latter is impracticable 
because the distance from zero to the smallest measure is so 
great compared with that from the smallest to the largest meas- 



FIQ. 49. ILLUSTRATION OF TWO METHODS OF SHOWING THAT 
ZERO LINES DO NOT APPEAR UPON GRAPHS IN THEIR 
TRUE POSITION 

ure that the differences between the different measures cannot 
be represented adequately without making the whole graph 
entirely too large. If it is impracticable to show in full the 
distance from zero up to the smallest measures, either the zero 
line should be shown and then a short distance from it a break 
bounded by wa\’y lines should be inserted, or else the figure 
should begin with a wa\'y Ime without representing zero. Prob- 
ably the first of these is the better practice Illustrations of both 
are given in Figure 49. In some instances it is satisfactory to 
show the same fact by the method employed m connection with 
frequency curves in Chapter III, that is, by the use of a brolmD 
portion of the base line. 

The zero line should be sharply distinguished from the otbBr 
lines, usually by making it heaiier. In case the data tabulated 
are expressed in per cents it is frequently desirable to aiiph4> 
i|ze the 100 per cent line in a sin^Kr fashion. The same is tma 
<if any other line representing a maximum that cannot be eap» 
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oeeded. When the first and last lines represent dates, or other 
data that do not constitute absolute limits to the measures 
given, they should not be so emphasized. The curves and other 
lines representing the data should be enough heavier than the 
coordinate and other guiding lines that there is no danger of 

confusing them. If sev- 


Adan>« 

ao4 


FranktlA 


1 


Unooln 

488 


] 


WMhIngtoa 

8Qg 


Ad*m« 

304 


Franklin 

088 


Lincoln 

488 


Waatilngton 
808 


eral types of data are 
represented they 
should be emphasized 
in proportion to their 
importance, if they 
differ in this regard, by 
lines varying in width 
or in some other way 
that accomplishes the 
same purpose. Eh'en 
if the various items do 
not differ in unportance 
it is often desirable to 
use different types of 
lines such as a solid 
line, a line of long 
dashes, a line of short 
dashes, a hne of dots, 
and so on, to avoid the 
CORRECT AND INTORHECT possibility of COnfu- 

sion. 

Another point that 
should be watched is 
the avoidance of op- 
For example, if bars are used to represent 


I Adnm* 

204 




Lincoln 

498 


: WMi 


MnfUW 

SOS 


FIO. BO. 

METHODS OF LABELING BARS 
IN A BAR GRAPH 

The upper two figuree represent two possible 
correct methods and the lower figure the most 
common incorrect one. 


tjcaT illusions. 

difbrent amounts by their lengths and the accompanying 
figures or words are placed at the ends of the bars they tend to 
distort the reader's judgment as to the ai^ual length. The 
figures or words should be placed withte the baati or in some 
other position where they do not produOe this effect. If, as is 
eommonly case, the ban are so placed that one end of each 
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liefl upon a conunon straight hne, figures ch* words may usually 
be placed at this end without causing any illusion. Figure 50 
illustrates the two correct methods just referred to, and also 
the incorrect method. 

Another common cause of optical illusions is the use of 
figures, usually rectangles, in which more than one dimension is 
changed to represent different amounts. For example, if this 

square j [ is used to represent a given quantity and it is de* 

sired to represent twice that quantity by another figure, one 
should employ a rectangle having the same width as the square 


and twice the length, thus. 


it thus, j I 


or still worse, thus, 


j or thus, I I and not do 
In other words, the 


comparison should be based upon a change in one dimension 
rather than m two or three. The ordinary reader can at once 
perceive that either one of the rectangles just given is approxi* 
matcly twnce as large as the original square, but not that the 
same is true of the second square or that the cube represented 
contains twice the cubic content of one having a side equal to 
the original square. 

When a curve is drawn to represent a number of observar 
tions or conditions it is usually best to represent each by a dot, 
cross, or some other symbol. The purpose of this is to make 
clear to the reader how nearly the curve actually fits the data 
from which it is derived. Figure 39 on page 240 illustrates this. 

When two or more curves, bars, or other types of figures are 
to be compared, the zero hnes should ordinarily correspcmd. 
The same is true of other features that enter into the cook 
parison. For example, if one wishes to compare the proplHp* 
tions of a class of seventy-five pupils receiving certain imudoB 
with the corresponding proportions of another class of thirty, 
both should be changed to some conunon terms, ordinarily 
per cents, so as to be directly comparable. 

When it is desired to show both amounts and ratios of change 



422 


STATISTICAL METHOD IN EDUCATION 


logarithmic oo6rdinate paper d^iould be employed, or two 
separate graphs, one for amounts and one for ratios, should be 
used. If logarithmic coordinate paper is used for a graph the 
figure should end at some power of 10 on the logarithmic scale. 

An important pnnciple when many graphs are to be em- 
ployed is that of variety. Even though the bar graph or some 
other type may be easily understandable, it should not be used 
over and over again because of the lack of mterest in such a 
presentation. An attempt should be made to introduce novelty, 
to insert striking features, and to adopt forms of graphs that 
are peculiarly appropriate to the data being dealt with. Several 
examples of this type will be given later, but it may be sug- 
gested as illustrations of what is meant that the round pie or 
dollar graph divided into portions may be used when dealing 
with expenditures; the map graph when dealing with geo- 
graphical matenal ; conventionalized figures of children, perhaps 
of two or more types, to represent different classes of pupils; 
white squares in larger black ones to show per cents window 
areas are of floor areas; and so on. 

Histograms, frequency polygons, and smooth frequency 
corves. Since these three kmds of curves, which are merely 
varieties of one t 3 q)e, have already been described in Chapter 
III, comparatively little attention will be given to them here. 
As suggested there, the chief use of these figures is in repre- 
senting distributions of data grouped into a number of classes 
that form continuous or approximately continuous distribu- 
tions. A single curve of this sort may be used to represent a 
angle distribution, or two or more such curves may appear as 
parts of the same figure to represent two or more distributions. 
Hiese curves, especially the histogram, are sometimes drawn 
with the base at the left rather than at the bottom. One advan- 
tage of this form is that it frequently lends itself better to the 
desired lettering or numbering so that the letters of numbers 
«lBd can be read without turning the page side-ways. No 
•ftastration of this will be given here, since it involves so Uttte 
•dmt is different from the ordinary type of histograin. 

A type of eorve somewhat similsc to thesp is often used to 
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show the amount or frequency in each of a number of dasses 
that cannot be Baid, when combined, to form a frequency dis- 
tribution in the usual sense of the term. This type of curve is 
usually drawn in polygon form and generally does not touch 
the base line at one end and frequently not at either. It is 
illustrated by Figure 51. The three curves appearing in thin 
figure show numbers 
of individuals enrolled of pupJIj 



in elementary, second- 
ary, and higher schools 
at each five-year period 
from 1900 to 1930. It 
is evident that the fre- 
quencies in the differ- 
ent classes, m this case 
the numbers enrolled 
at the different penods, 
cannot logically be 
combined to form an 
ordinary frequency dis- 
tribution. 

This figure also 
serves to illustrate 
negatively one of the 
principles stated ear- 
her in the chapter. 

The scale of the figure 
is such, due to the 
numbers of the ele- 
mentary-school pupils 
concerned, that the 
curve representing the 
comparatively small number of individuals in hi^er schools 
does not change sufRciently from time to time to give an nil* 
curate idea of the increases occurring therein. The curve 
resenting the number of secondary-school pupils also aeareely 
does so. There is no satisfactory way of avoiding this if it to 


RESENTING NUMBERS OF CASES IN 
EACH OF SEVERAL CLASSES THAT 
ARE CONTINUOUS BUT DO NOT 
UNITE TO FORM A FREQUENCY 
DISTRIBUTION 

The three curves appeanns in this Satire ahov 
onroUmonts in elementary, secondary, and hitler 
schools at each Sve year penod from 1900 to 1^90, 
inclusive. 
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decmd to combine on the same graph aevOTal different sets of 
data some of which contain many times as many cases as others. 

The next figure, No. 52, illustrates a somewhat similar type 
of graph. It shows the first quartile, median, and third qoartile 
Sean handwriting scores of 

•WOj pupils in Grades 1 to 

8, inclusive. For each 
•0 of these three sets of 

curve of the 

•0 ^ type described in the 

‘ preceding paragraph 

^ " lias been drawn. The 

area between the 
**> curves representing 

“ the first and third 

*} 2 3 4 5 6 7 8 quartile scores has 

been shaded for em- 
FIG. 62. ILLUSTRATION OF FIGURE EM- . . . 

PHASIZING AREAS CONTAINED BE- POASIB. It IS divided 
,, TWEEN GIVEN CURVES into two portions by 

The shaded surface in the fifture above is that n heavy line that rep* 
between the first and third quortiles of the hand- x j- 

%Titing scores mode by pupils m Grades 1 to 8 r®8CUtS tne median 

huduoive. it is divided into two portions by a sCOrCS. By Comparing 

fine representing the median scores. , . ... 

• ' the total width, or ver- 

tical dimension, of the shaded area in one grade with that in 
another, one can determine the relative spread or variability 
of the scores in the grades under consideration. 

Bar graphs. Probably the most commonly employed type 
of graph is the bar graph. Many varieties of this type are used 
to represent data of many different kinds. Probably the com- 
pionest is the set of bars of equal width with lengths in propor- 
tion to the numbers or amounts represented. This is illustrated 
ih F^ore 50 on page 420, in which the lengths of the four bars 
pte iBoportiomIt to the numbers of pupils enrolled in four 
htdldiDgs. In constructing such a graph it is common to use 
eitlier a logical order, such as alphabetical or ebronobgical, or 


to arrange the ban in a given set in order of size with the longest 
At ^th^ the top or the bottom slinKtest at the otAw 
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extreme. The bars are commonly placed as in figure 50^ and 
differ in horizontal length, but noay be placed side by side and 
differ in height. This same fact, that the base may be taken 
either at the bottom or at the left, holds with regard to all ot 
practically all other varieties of bar graphs as well. 

The next figure, No. 53, illustrates the use of the divided 
bar for purposes of comparing the proportions into which two 


Gudas 1-6 


7-9 


10-12 

67>l 

zaj 

9.5 

fiystim A 

01.6 

23.2 

12.2 


SytUm B 

no 63 ILLUSTRATION OF DIVIDED BARS USED FOR 
COMPARING PROPORTION 


The two blue m the figure above represent the pupil enroUmeota in two 
school systems Bach is divided into three parts of which the first represents 
the proportion or per cent of all pupils enrolled in Grades 1 to 6. the secootl 
that of pupils enrolled m Gradee 7 to 9, and the third that of those in Grades 10 
to 12. 

or more wholes are divided. The two bars in this figure repre- 
aent the enrollments in two school systems expressed in tenna 
of per cents. They are of the same width and also of the same 
length. Each is divided into three parts, one of which repte* 
Bents the per cent of pupils enrolled in Grades 1 to 6, the secmid 
that of pupils enrolled in Grades 7 to 9, and the third that of 
those in Gradee 10 to 12. 

An additional feature is introduced into the next figure. 
No. 54. This figure represents the total expenditures of three 
school eystems and the proportions thereof devoted to eadi 
of the five purposes named. The different whlths of the bara 
lepresent the different amounts of total expenditure, whemas 
the different laogths of the divimons into which the bars are 
divided represent 'the different proportions of expenditure. 
The areae of the yarts,' ^jace each repreaents the product of 
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the total expenditure times the per cent, represent the actual 
amounts spent for the five purposes. In this case the divisionB 



City C 


Te«ch«n | | 


Books and Supplies 



General Control 



Supervisors 



Other Expenses 

IIO. 64. ILLUSTBATION OF DIVIDED BARS USED FOR COMPARING 
BOTH ACTUAL NUMBERS OR AMOUNTS AND PROPORTIONS 

Thu figure repreeenta the per capita ezpenditurea of three achool ayatema. 
It differe Irom) Figure 63 in that the bars are of different arjdtfas correapondina 
to the total amounta which they repreeeot. The diviHona of each bar repraaentt 
the per oenU of total expenditures devoted to each of the five purpoaee named.. 


ci the bars have been shaded differently to distmguish them 
from one another. 

Althoo^ the bar graph given in Figure 55 differs only fixHn 
jme of those in Figure 53 in that its length is vertical rather 
than horiamtal, it has seemed well to present it because it 
illustrates a fonn that is frequently useful. It represents the 
nombers and also the proportions of pupils in a school 
enrolled in each grade from 1 to 12, inclusive. The hdlghts and 
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e 5 

a 


consequently the areas of the different 
portions into which the bar or rectangle 
is divided are proportional to the en- 
rollments in the various grades. 

A still different variation of the bar 
graph is shown in Figure 56. Each group 
of three bars or rectangles in this figure 
shows the per cents of pupils m three 
school systems exceeding the general 
median score in each of five subjects. 

In graphs such as this, the bars are 
Bometunes merely outlined and some- 
times are colored or shaded differently. 

Furthermore, the bars forming any one 
group, in this case the three represent- 
ing performance in each subject, may be 
drawn either with their adjacent sides 
common, as shown in the figure, or they 
may be drawn separately. In the latter 
case the space between the bars m any 
one group should be comparatively small 
compared with that between the differ- 
ent groups, so as to avoid possible con- 
fusion m interpretation. 

Pyramid graphs. This not very com- 

X t u j i • FIG 56 ILLOSTBA- 

mon form of graph provides what is xiON OF single ver- 

probably a more effective way of pre- tical bar or reo- 
senting data such as were illustrated in division of a 

Figure 55 than does the form of bar WHOLE INTO PARTS 
graph employed therein. It consists of The areaa or heu^ts of 
a series of rectangles of equal heights 

and of lengths proportional to the data reeent the pupil enroO- 
represented arranged one above the ^ i to 12. 

other in the general shape of a pyramid. It is illustrated in 
Figure 57, which represents the same data as does Figure 55. 

Qrcle or pie graphs. Circle or pie graphs are very frequently 
used to show the division of a whole into parts, frequently 
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2M 
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821 

947 

1064 

n52 

1197 

1208 

1185 
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Adth. Ra«d. Spall. Lang. Writ 
School School B fllM School C I I 

no. 66 ILLUSTRATION OF BARS USED TO COMPARE THE SAME 
SUBJECTS ON EACH OF SEVERAL POINTS 

The figure above represents graphically the per cents of pupils in each of three 
Boboola exceeding the median score m each of the five subjects named. 


thought of aa representing a dollar and the divisions as showing 
how many cents out of each dollar are spent for each of the 


purposes indicated. Its use is 
by no means limited to financial 
matters, however. In Figure 58 
two illustrations of the use of 
such a graph are given The 
circle at the left is divided into 
(hree parts which represent by 
their proportional areas the per 
cents of pupils who have made 
normal, accelerated, and re- 
tarded progress. The circle at 
ihe right shows the per cents of 
dty expenditure or, in other 
words, the cents out of each 
(fadlar, devoted to each of the 
ten purposes named. Some- 
tfcnes in such hgures as these 
tibe different sectors ot the circle' 


Grad* 

nul 

Enrolltntnt 



no. 67. ILLUSTRATION OF 
pyramid graph 


The arm* or length* of the twelvs 
divfsoiia or step* roprocnt the enroU- 
nMit* in Grades 1 to 12. 

♦ 
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are colored, idiaded, or otherwise distinguished from one another, 
but it seems to the writer that it is usually best not to do so. 

Occasionally one sees a series of concentric circles used to 
show relative sizes or amounts. However this is rarely, if ever, 
desirable. It violates the principle already stated, that com- 




FIG. 58. ILLUSTRATIONS OF CIRCLE OR PIE GRAPHS 

The figure at the left rapresenta the per oenta of pupUa m a ayatem who hav* 
made normal, accelerated, and retard^ pn^reaa, and the one at the light th* 
per oenta of city ezpendituree devoted to each of the ten purpoaea given. 

parisons should be made in one dimension only and not in two 
or more. 

Thermometer graphs. In many cases an effective and striking 
way of pointing out certain facts is by the use of graphs re8eiD> 
bling a thermometer. This ^rpe is illustrated in Figure S9. 
This graph shows that the median handwriting score of a group 
of pupils is only 63, whereas the standard set is 70. Further- 
more, it shows that the total possible range of scores is from 
0 to 100. Sometimes several additional pomts marked <mi 
this type of graph. Thus, especaally in connection with test 
scores, the median and the first and third quartiles may be 
shown, or a number of percentiles may be marked on the thmw 
mometer. 

Graphs diowing change. There are several types oi graphs 
that may be used to show the change in individuals enr groups 
of individuals from time to time. One variety that may be 
used for this purpose is that already illustrated in Flgores 49 
and 51. Such a figure is suitable for showing tlii (hanges in 
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one or a few individuals or things during a number of periods. 
If, however, it is desired to show the changes in a larger num- 

her of subjects it is usually best to intro* 

lOO-pi duoe a slight modification. The type of 

graph recommended for this purpose is 

shown in Fig- 

ure 60. In this ^ ■ ■ i! ^ ^ 
--•sundard figure are shown m 

i 'ldian the scores of a * ^ 

number of pupils ^ 

on two tests. A 

straight line con- ® ^ 

nects the two i- 7 ** 

scores made by _ S 

each pupil. If J f 

one did better e i6 1 

on the second 15 — y/^- K is" 

test than on the u / — 14 

first the slant of is u 

his line is up- la 

— ward to the u 11 

TCION OF THER- “ nlS seo- 10 U 

■MOMETER graph ond score was 9 8 

Thw figure repre- the same as his S 8 

writing mre of a group FIG. 60 . ILLUSTRATION 

«t pt^ia aa oompared perfectly hori- OF GRAPH SHOWING 
witb tlie ataudard aet. j :r CHANGE FROM ONE 

w)ntal,andif his another 

second score was lower than his first ^lua figure riiowa the aoor,. 
the line dants downward. Thus the made by each pupU in a olaaa 
grwb Kobe it evident that pM » “ JS 
A made a lower score the second a atraigbt Une tbo aLant of 
time tlKKi tbe fixd. tlxrf pnpU B did 

better tihe seooiul time than the wone, <» the aeoond Wat tiwa 
first, that C the same score ®“ **** 
both tiiQee,;iisi so im. A graph such as this may be ecm- 
tlon^ to to d^ow scores on ibe third, the fourth, 

and masiii^ other tests as desired and, likewise, the ehanges 


FIG. 60 . ILLUSTRATION 
OF GRAPH SHOWING 
CHANGE FROM ONE 
TIME TO ANOTHER 
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betwem each two testing periods. When this is done it is ordi- 
narily desrable to do as shown on the figure and plaoe th» 
letter or other symbol indicating each pupil on the line of 
change between each two test scores, otherwise it is ratim 
difficult to follow each pupil's line fivm b^inning to end. 

Cartoon graphs. The use of the cartoon graph has its jus- 
tification chiefiy m the visual appeal that it carries. If cme 




FIG fll ILLUSTRATION OP CARTOON GRAPHS EMPLOYING 
HUMAN FIGURES 


The upp»er half of this shows the proportions of children sttendinc 

school m classrooms approximately up to standard and of those whose attend* 
ing in claasrooms not up to standard The lower part shows tbs p r opor t ion of 
pupils having available sufficient playground space and the prc^rtioQ not 
having such space ovaUable. 

wishes to inform the public, for example, that 80 per cent of 
the children in a school system have received satisfactoiy 
dental treatment, whereas 20 per cent have not, it is usually 
more effective to present a cartoon graph containing eig^t In- 
ures of children who have received satisfactory treatmez^ 
two who have not received it thanaoefely to presuxt a bar, 
example, divided into two portions of which one is mf^rt-tenths 
of its length and the othw two-tcoOS. Probiddy tiie most 
effective cartoon graidis are those in human Iteraa ai« 
represented, but their content ihoold imt be ilMli 

iBgures. Pi^ of money, dollars cut up into pait8> 
iBgs, pupib’ desks, and many other tinnga in sonatn 



432 


STATISTICAL METHOD IN EDUCATION 


nected with the school may well be represented. In doing so, 
however, one should bear in mind the general principle of 
variety stated earlier. The repeated use of the same type of 
cartoon causes it to lose much of its effectiveness. Such graj^ 
should, therefore, be saved for presenting the more important 
facts or those to which it is difficult to secure public attention. 

Figure 61 illustrates the use of the human figure in cartoon 
graphs. The upper half of the figure shows the proportions of 



SUndanl Our Schools 

FIG. «2. ILLUSTRATION OF CARTOON GRAPH REPRESENTING 
RELATION OF WINDOW AREA TO FLOOR AREA 

This figure shows that the proportion or per cent of window area to floor area 
in a given system is considerably leas than the given standard. 

children attending school m classrooms approximately up to 
standard and in classrooms not up to standard. According to 
it, six out of every ten children are in standard rooms and four 
out of every ten are not. The latter are colored black, since 
this color is commonly employed to represent imdesirable con- 
ditions in contrast with white, which usually portrays desirable 
conditions. The lower portion of the figure shows that three 
out every ten children have sufficient playground available, 
whereas seven out of eveiy ten do not. It will be noted that in 
this case there is a difference in the conventionalised figures 
employed to lepresent pupils at play and not at play. 

Tbe next figure, No. 62, represents a type of graph that 
might be called a cartoon cp^pb might perhaps be classified 
otherwise. It contains two drawings, one (rf wffich rq>reawt8 
the generally accepted standard for the relation of window area 
to floor area and the other the avenge found in a ghrm school 
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i^ygtem. It is evident from a ocnnparison of the two that the 
actual avera^ la much below the standard. 

Another type of cartoon graph that likewise is closely related 
to a previously mentioned type is that in which columns of 
doUiuu are used to represent different amounts of money. This 
is similar to the use of rectangles varying in their vertical 


height for the same purpose, 
but is more striking. An illus- 
tration 18 given m Figure 63. 
The first pile of dollars in the 
figure represents the educa- 
tional tax per $1000 of true 
wealth in a given system and 
the other the average corre- 
sponding tax m a group of 
comparable systems. It is at 
once apparent that the smgle 
system concerned is distinctly 
below the average of the 
group. 

Map graphs. In many 
cases the use of map graphs 
is an effective way of pre- 



FIG 63 ILI>USTR.\T10N OF CAR- 
TOON GRAPH EMPLOYING 


senting facts Perhaps their columns of dollars 


prime use is m connection This figure shows that the aetual tax 

with the Tilanninir of school educational purpoeos, per $1000 of 
Wl^ tne pianmng Ol scnooi wealth, m a given system is con- 

building programs and of the siderably less than the average for a 

determination of the build- comparable systems. ^ 


ings that pupils should attend. The ordmary type used for 
this purpose is what is sometimes called the dot map or point 
map, that is, an ordinary map with a dot or point upon it for 
each individual m whom the school is interested. Frequently 
different types of marks are used for pupils in different gradee^ 
such as a dot for each pupil in the first to sixth grades, a (urcle for 
each one in junior high school ai;id ajaquare for each one in senitv 
high school. In oo];)pection with Um planning of school building 
programs circles are commonly lirawn around the sites or pro- 
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posed rates with radii of ooe-half, three-foxirths, one, or somo 
other number of miles considered the desirable mayiTniim dia- 
tance between pupils* homes and the school they attend.^ This 
type of map with the dots and circles is so common that it seems 
scarcely worth-while to represent it here, hence no sample is 
given. It may be found in almost any building survey. 

Exercises 

No specific exercises are provided for this chapter, but it is recom- 
mended that students prepare the appropriate t3rpes of graphs for 
various data in which they are interested. 

’ In considering the distance pupils must walk to school it should not 
be overlooked that this is rarely represented by a straight line from the 
place of residence to the school building. Instead the pupil must ordinarily 
take a course that more or less approximatee the two sides of a right tn- 
angle of which the shortest straight line is the hypotenuse. Therefore 
the msTitniiTn distance that pupils must go to reach school is equal to 
annxHdmately the VZ tunes the radius of the circle. 
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TABLES OF THE HEIGHTS, AREAS, AND CORRE- 
SPONDING RATIOS OF AREAS OF A NORMAL 
DISTRIBUTION CORRESPONDING TO STAN- 
DARD AND MEDIAN DEVIATION UNITS 

The first column of each of the two tables in this appendix 
contains entries m terms of the standard deviation and the 
median deviation or probable error, respectively, which repre- 
sent distances from the mean of the distribution. In the second 
columns are given the heights of the curve at the given o and 
MdD distances from the mean. These are given in terms of a 
height of 1.00 at the mean or maxunum ordinate. If, as is some- 
times convenient, they are desired in terms of an area of 1.00 

each should be multiplied by which equals .39894228 

approximately .4. The entries in the third columns give the 
areas contained between the mean and ordinates at the given dis- 
tances from the mean. These areas are given in terms of an area 
of 1.00 for the whole curve and are those on one side only of Uie 
mean, so that if the total areas within the given distances of 
the mean are desired, the tabular entries must be mulUidied 
by two. The fourth columns give the areas beyond the given 
distances from the mean. In this case, as in the previous one, 
if one desires the total areas beyond these distances the en- 
tries in these columns must be multiplied by two. In the fifth 
columns are the approximate ratios obtained by dividing each 
entry in the third columns by the corresponding one in the 
fourth, or, in other words, the ratios of the areas included within 
the given distances of the mean to those beyond them. Eadi 
ratio is the number of chances to 1 that a parti«»ilar case lies 
within the given distance in the third oolunm. The entries in 
the lApt columns are the approximate ratios obtained hy divid- 
ing each of the entri^ in the third columns phu .& by the coiv 
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responding entry in the fourth colunms, and thus are the ratios 
€i the areas of the larger of the two portions into which the 
total area under the curve is divided by the ordinate at the 
given distance to that of the smaller of the two portions. They 
are, therefore, the chances arrived at by the experimental co* 
efficient or critical ratio method, that is, the chances that a 
particular case is on one side of the given point or distance from 
the mean rather than on the other. Each entry in these columns 
is equal to one more than twice the corresponding entry in the 
previous column. In the accompanying tables, however, the 
larger entries are approximated enough that this relationship 
is not exact. 
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Hxiohtb, Absas, and Cobbkspondinq Ratios of Abbiab of a Nobiial 
D iBTBiBtmoN CoBBBSFONDiNo TO Standabd Dbyiation Unitb 


ff 

Dittanee 

from 

Mean 

Height 
at Given a 
Distance 

Area 
betuoeen 
Ordinate 
at Given a 
Distance 
and the 
Mean 

Area 
beyond 
Ordinate 
at Given a 
Distance 

Ratio of 
Area 
between 
Ordinate 
and Mean 
to That 
beyond 
Ordinate 

Ratio of 
Area of 
Whole 
Curve on 
One Side of 
Ordinate to 
That on 
the Other 

.0 

1.0000 

.0000 

5000 

.00 

1 00 

.1 

.9950 

.0398 

.4602 

.09 

1.17 

.2 

9802 

.0793 

4207 

19 

1.38 

.26 

9692 

0987 

4013 

.25 

1 49 

.3 

.9560 

1179 

3821 

.31 

1.62 

.4 

.9231 

1554 

3446 

45 

1 90 

.6 

.8825 

1915 

.3085 

62 

224 

.6 

.8353 

2257 

.2743 

.82 

265 

.7 

.7827 

.2580 

2420 

1.07 

313 

.76 

.7548 

.2734 

2266 

121 

3.41 

.8 

.7261 

.2881 

2119 

1.36 

3.72 

.9 

.6670 

.3159 

1 1841 

1 72 

4.43 

1.0 

.6065 

.3413 

1587 

2 1 

5.3 

1.1 

.5461 

3643 

1357 

27 

6.4 

1.2 

.4868 

3849 

1151 

33 

7.7 

1.25 

.4578 

.3944 

.1056 

37 

8.5 

1.3 

.4296 

.4032 

0968 

4.2 

9.3 

1.4 

.3753 

.4192 


62 

11.4 

1.6 

.3247 

4332 


6.6 

14.0 

1.8 

.2780 

.4452 

0548 

8.1 

17.2 

1.7 

2367 

.4554 

0446 

10 2 

21.4 

1.75 

.2163 

.4599 

0401 

11.5 

24.0 

1.8 

.1979 

.4641 

.0359 

12.9 

26.8 

1.9 

.1645 

.4713 

.0287 

16.4 

33.8 

2.0 

.1353 

.4772 

.0228 

21 

43. 

2.1 

.1103 

.4821 

.0179 

27. 

55. 

2.2 


.4861 

.0139 

35. 

71. 

2M 

.0796 

.4878 

.0122 

40 

81. 

2.8 

.0710 

.4893 

.0107 

46. 

92. 

2L4 

.0561 

.4918 


60. 

121. 

2.6 

.0439 

.4938 


80. 

16a 
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JiaKXBTB, Abbas, and Corbespondino Ratios or Abbas or a Nobmai. 

DlBTBtBimON COBRESPONDINQ TO StaBDABD DstIATION 
Units — Continued 


JjfUlanet 

from 

Mean 

1 

! 

Heif/ht 
at Qveen a 
Dietanee 

Area 
between 
Ordinate 
at Given a 
Dietanee 
and the 
Mean 

Area 
beyond 
Ordinate 
at Given a 
Dietanee 

Ratio of 
Area 
between 
Ordinate 
and Mean 
! to That 

1 beyond 
Ordinate 

Ratio <4 
Area of 
WhdU 
Curve on 
One Side of 
Ordinate to 
That on 
the Other 

2.6 

.0340 

.49534 

.00466 

106 

214. 

2.7 

.0261 

49653 

00347 

143. 

287. 

2.76 


.49702 

00298 

167. 

335. 

2B 

.0198 

.49744 

.00256 

194 


2.9 

.0149 

49813 

.00187 

267. 

535. 

3.0 

[ 0111 

49865 

.00135 

370. 

740. 

3.1 

00819 

49903 

.00097 

520. 

1030. 

3.2 

1 .00698 

49931 

.00069 

730. 

1450. 

3.26 

.00509 

.499423 

! .000577 

870. 

1730. 

8.3 

t .00433 

499517 

000483 

1030 

2070. 

8.4 

.00309 

499663 

000337 

1480 

2970. 

8.5 

[ .00219 

499767 

.000233 

2150 


3.6 

.00153 

499841 

000169 

3100 


3.7 

.00107 

499892 

000108 

4600. 


8.76 

.00088 

499912 

,000088 

5700. 

11300. 

8.8 

.00073 

499928 

000072 

6900. 

13800. 

3.9 

00050 

.4999519 

0000481 

10400. 


4.0 

.00034 

.4999683 

.000(B17 

15800. 

31500. 

4.1 

.000224 

.4999793 i 

.0000207 

24200 

48300. 

4.2 

.000148 

.4999867 

0000133 

37600. 

75200. 

4.25 

.000120 

.4999893 : 

.0000107 

47000. 


4.3 

.000097 

.4999915 

.0000086 

59000. 

iisooa 

4.4 

.000062 

4999946 

0000054 

93000. 

issooa 

4.6 

.000040 

.49999660 

00000340 

147000. 

20400a 

4.6 

■lOXiTn 

.49999789 

.00000211 

237000. 

473000. 

4.7 

iwooie 

.49999870 

00000130 

384000. 

7e90oa 

4.76 

.000018 

.49099898 

00000102 

490000. 


4.8 

.000010 

.49909921 

.00000079 

i^BlwrrTH 

1200000. 

4.9 


.40009962 

.00000048 

1040000. 

W'.ii'Vi 1 1^1 

6.0 


.49999071 


174000a 




















Bvrjhts, Abbas, and CosRBSPONBUfo Ratios or Abbas or a Nobkas. 
Dibtbibotion CoRBSSPONsiNa TO Mbdian Deviation ob 
Probabub Erbob Units 


MdD 
or PE 
Dietanee 
from 
Mean 

Height at 
Oioen MdD 
or PE 
Dietanee 

Area 
between 
Ordinate at 
Owen MdD 
or PE 
Distance 
and the 
Mean 

Area 
beyond 
Ordinate at 
Given MdD 
or PE 
Distance 

Ratio of 
Area 
between 
Ordinate 
and Mean 
to That 
beyond 
Ordinate 

.0 

1 0000 

0000 

5000 

.00 

.1 

.0977 

0269 

.4731 

.06 

.2 

.9909 

.0537 

.4463 

.12 

.25 

.9859 

0670 

.4330 

.16 

.3 

.9797 

.0802 

.4198 

19 

.4 

.9643 

.1063 

3937 

.27 

.6 

.9447 

.1320 

.3680 

.36 

.6 

.9214 

1571 

.3429 

.46 

.7 

.8945 

1816 

.3184 

.67 

.75 

.8799 

1935 

.3066 

.63 

.8 

.8645 

2053 

.2947 

.70 

.9 

.8317 

2281 

.2719 

.84 

1.0 

7965 

.2500 

.2500 

1.00 

1.1 

.7594 

.2709 

.2291 

1.18 

1.2 

.7207 

.2908 

.2092 

1.39 

125 

.7009 

3004 

.1996 

1.61 

1.3 

.6808 

3097 

.1903 

1.63 

1 4 

.6403 

.3275 

.1725 

1.90 

1.6 

.5994 

.3442 

.1558 

2.21 

1.6 

.5686 

3597 

.1403 

2.66 

1.7 

.5182 

.3742 

.1258 

2.98 

1.76 

.4083 

3811 

.1189 

3.2 

1.8 

.4785 

.3876 

.1124 

3.5 

1.9 

.4309 

.4000 

.1000 

4.0 

2.0 

.4026 

.4113 

.0887 

4.6 

2.1 

.366T 

4217 

.0783 

5.4 

2.2 

.3326' 

.4311 

.0689 

6.3 

2.26 

.3161 

.4354 


6.7 

2.i 

.3002 

.4396 


7.3 

2.4 

.2698 

.4473 

.0627 

8.6 

2.6 

.2413 

.4541 

.0469 

9.0 

2.6 


.4603 

.0397 

11.6 

2.7 


.4667 


13.6 

2.75 


.4682 

.0318 

14.7 

2A 

.1681 

.4706 

.0295 


2.9' 

.1476 

.4748 

.0252 

18.8 ' ' 

9M 

.1201 

.4786 

.0215 

22,2 


Ratio (ff 
Area of 
Wholo 
Cvarvt on 
OneSidoof 
Ordinate to 
Thai on 
the Other 

1.00 

1.11 

1.24 

1.31 

1.38 

1.54 

1.72 

1.02 

2.14 

2.26 

239 

2.68 

3.00 
3.37 
8.78 

4.01 
4.26 
4.80 
6.42 
6.13 
6.96 
7.4 
7.9 
9.0 














HmoiiTB, Assab, and Cobbespondinq Ratios of Abbas or a Nobkal 

I^TBIBimON COBBESPONDINO TO Mk>IAN DSTIATtON OB 
Pbobable Ebbob Untib — Continued 


MdD 
or PE 
Dietanee 
from 
Mean 

Height ai 
Given MdD 
or PE 
Dutance 

Area 
between 
OrdinaU at 
Gwen MdD 
or PE 
lhatance 
and the 
Mean 

Area 
beyond 
Ordinate at 
Gwen MdD 
or PE 
Distance 

Ratio of 
Area 
between 
Ordinate 
and Mean 
to That 
beyond 
Ordinate 

Ratio of 
Area </ 
Whole 
Curve on 
One Side of 
Ordincde U> 
Thai on 
the Other 

3.1 

1124 

.4817 

.0183 

26 

54. 

3.2 

.0974 

4846 

.0154 

31. 

64. 

3 2o 


4858 

.0142 

34. 

69. 

3.3 


4870 

.0130 

37 

76. 

34 

.0721 

4891 

0109 

46. 

91. 

3.5 


4909 

.0091 

54. 

109. 

3.6 

0524 

49241 

.00759 

65. 

131. 

3.7 

0444 

49371 

.00629 

79. 

158. 

3,75 


,49429 

.00571 

87. 

174. 

3.8 

.0375 

49481 

.00519 

95. 

192. 

39 

0314 

49.574 

00426 

116 

234. 


0263 

49651 

00349 

142. 

286. 

4 1 

0219 

49716 

.00284 

175. 

351. 

42 

0181 

49769 

.00231 

216 

433. 

4 25 


49793 

.00207 

240. 

481. 

43 

0149 

19814 

00186 

267. 

535. 

44 

0122 

498.50 

001.50 

332 

666. 

4.5 

OKXX) 

49880 

.00120 

416 

831. 

4.6 

,00812 

499041 

.000959 

520 

1040. 

47 

006.57 

499238 

.000762 

660. 

1310. 

4 75 

fX)590 

499322 

.000678 

740 

1470. 

4.8 

00.530 

499.197 

.000603 

830 

166a 

49 

0042,5 

49952.5 

000475 

10.50. 

2100. 


00339 

499627 

.000373 

1340. 

2680. 

51 

00269 

499709 

.000291 

1720. 

344a 


.00213 

.499774 

.000226 

2210 

4420. 

6.25 

.00189 


.000199 

2510. 

6020. 

S3 

.00168 

499825 

.000175 • 

IK50. 

5700. 

6.4 

.00132 

499865 

.000135 

3700. 

7400. 

6.5 

.00103 

499896 

.000104 

4800. 

9600. 

6.6 

.a)0798 

4999207 

.0000793 

6300. 

12600. 

6.7 

.000617 

.4999396 

0000604 

8300. 

16600. 

6.76 


.4999474 

.0000526 


19000. 

6.8 

.000478 

.4999543 

.0000457 


21900. 

6.9 


.49996,55 

.0000345 

^4500. 


6.0 

iKml 

.4999741 

.0000259 

19300. 
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APPENDIX C 

VALUES and logarithms OP CERTAIN CON- 
STANTS EMPLOYED IN EDUCATIONAL 


Constant 

STATISTICS 

Value 

Logarithm 

v'5 

1.4I42I356 

.16051500 

V3 

1.73205081 

.23856063 

VI 

2.23606798 

.34948500 

Vio 

3.16227766 

.50000000 

ir 

*- 

3 14159265 

.49714987 

.31830989 

9.50285013-10 

1 

1.77245385 

.24857494 

J 

Vir 

.56418958 

9.75142506-10 

V^ 

1 

V2ir 

2.50662827 

.39908993 

.39894228 

9.60091007-10 

e 

1 

2.71828183 

.43429448 

e 

.36787944 

9.66670552-10 

1 

1.64872127 

21714724 


.60653066 

9.78285276-10 

PE 

.674489750- 

9.82897535-10 

<r 

1.48260222F^ 

.17102465 


m 
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INDEX OF TOPICS 


a. See Fourfold table. 

Abedsea, 33 
Absolute accuracy, 8 
Absolute range, 116, 136 
Accidental error, 56, 336 
Accuracy, 7 

AD. Symbol for Average deviation 

Adding machines, 6 

Aids to computation, 5 

Area of normal frequency curve, 439 

Anthmetic mean, 67 

Array, 163 

Assigning marks, 388 
Assigning ranks, 224 
Assumed mean, 69 
Assumption of symmetrical dis- 
tribution within class, 23 
Asymmetrical curves, 62 
Attenuation, 215 
Attributes, 14, 309 
Average deviation, 119 
Aversigcs, 66 

Averaging coefficients of correla- 
tion, 207 

Averaging quahtative data, 380 
Axes, 32, 237 

Ayres's, method of computing coef- 
ficient of correlation, 154, 169; 
method of computing coefficient 
of regression, 243; method of 
computing ratio of correlation, 
261; method of computing stand- 
ard deviation, 190 


b. Set Fourfold table. 
b. Symbol for Coefficient of regres- 
sion. 

b. Symbol for Intercept. 

Bar grairii^ 430, 434 
fi (beta) coefficient, 246, 305 
Biaaed error, 886 


Bibliography, 435 
Bi-modal distribution, 91 
Bmomial expansion, 56 
Bi-serial, coefficient of correlation, 
321; ratio of correlation, 323 
Blakeman’s criterion of linearity, 
254 

Brown’s formula, 209 
Brown-Spearman fomiula, 209 


C. Symbol for Coefficient of con- 
tingency 

C Symbol for Common factor. 
e See Fourfold table 
e- Symbol for Constant, 
e. Symbol for Correction. 
Calculating machines, 6, 172 
Card punching and sorting ma- 
chmes, 6 

Cartoon graphs, 431 
Causal factors m coefficient of cor- 
relation, 190 

Central tendency See Averages. 
Certainty of prediction, 192 
Chance error, 56, 336 
Change, 404 
Change graphs, 429 
Changmg quahtative data into a 
normal distribution, 378 
Chaiping rank correlation ooeffi- 
cieSls to [Moduct-iooment ones, 
228 

Changing ranks to p^oentiles. 111 
X (chi). See Oo^eient of oontin- 
gcncy. 

X *' (Chi-square) test for goodnsas 
of fit, 386 
Qrote graphs, 437 
Qass, 18 

Cbasifioatioii, 14, 18 
Oassiutarval, 19, re,fl0 
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INDEX OP TOPICS 


CIbbs limits, 19, 26, 80 
CHass mark, 27 
Gisss nud'point, 20, 75 
Class tjrpe, 27 
Class width, 19, 73, 80 
Coefficient, of alienation, 193; of 
association, 312; of colligation, 
312; of contingency, 314; of 
correlation, 151; of correlation 
based on mean deviations, 184; 
of correlation of fourfold table, 
310; of correspondence, 231; 
of dependability, 193; of deter- 
mination, 197; of indejiendent 
determination, 277; of multiple 
correlation, 283; of multiple re- 
gression, 299; of non-determina- 
tion, 197; of part correlation, 272; 
of partial correlation, 263; of 
partial regression, 299; of rank 
oorrelation, 225; of regression, 
240; of reliability, 208; of self- 
correlation, 208, of semi-partial 
correlation, 274; of variability, 
140; of variation, 140 
C of L. Symbol for Cnterion of 
linearity 

C of V Symbol for Coefficient of 
variability. 

Cdumn diagram, 34, 41, 422 
Common factor, 191 
Comparable measures, 246, 405 
Comparing coefficients of correla- 
tion, 200 

Comparison, and measurement of 
change, 404; of actual and normal 
distributionB, 382; of averages, 
99; of measures of variability, 132 
Computing machines, 6, 172 
Computing tafaka, 5 
Constant error, 336 
Constants, 

Constrioti^ 221 
Construction of nOTmal curve, 57 
Contingency, 314 
Continuous distributton, 27 
Coordinate axes, 32, 287 
Correction, for grouping, 127, 256, 
!i 820; for number of caBe^ 206, 


293, 365; of attenuation, 215; 
to coefficient of contingency, 319; 
to coefficient of correlation, 206, 
215; to coefficient of multiple 
cori^ation, 292; to denominators 
of measures of reliability, 333; 
to mean, 72; to mean deviation, 
119; to median, 121; to ratio of 
correlation, 256; to standard 
deviation, 127 

Correlation, 66, 143; charts, 171; 
graph, 240; machines, 172; of 
attributes, 309; of measures not 
m senes, 176; of one vanable 
with sum or average of others, 
175, ratio, 250, 324, table, 162 
Corresjiondenoe, 231 
Cosine IT (pi) method of correlation, 
312 

Cnteria for averages, 98 
Cnterion, 196, 364; of hneanty, 254 
Cntical ratio, 360 
Crude mode, 87 

Cumulative frequency, curve, 46; 
table, 28 

Curve fitting, 64, 382, 413 
Curve of error See Normal fre- 
quency curve 

Curvilinear, correlation, 147, 250; 
multiple correlation, 293; mul- 
tiple regression, 307, relationship, 
147, 250, 293, 307 


D Symbol for Difference in rank 
Dio-m Symbol for 10-90 percentile 
range. 

d. See Fourfold table 
d Symbol for Deviation 
d. Symbol for Difference. 

Dee Symbol for Decile. 

Decile, 113 

Determination, of class mid-point, 
75; of class width, 21 ; of difficulty 
of test elements, 3W; of ment 
from judges’ ratings, 392; of 
proportion of cases between two 
points on a scale, 1 15, 388 
Deviation, 60, 115 
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Diehotonunu elaarificatton, 309 
Differexiee, between ratio and coeffi- 
dent of correlation, 253; in rank, 
226 

Differences, 350 
Dilation, 221 
Direct correlation, 144 
Discontinuous distribution, 28 
Discrete senes, 28 
Dispersion, 115 
Displacement, 204 
Distortion, 221 
Distribution of marks, 388 
Doolittle method of computing 
coefficient of multiple correlation, 
289 

Double classification, 309 
Dropping decimals, 11 


E Symbol for Coefficient of de- 
pendability 

e. Symbol for Napierian logarithmic 

b^ 

«. Symbol for Vanable error 
Effect, of grouping upon coefficient 
of correlation, 178; of increasing 
length of test upon reliability, 
210; of spread of data upon coeffi- 
cient of correlation, 199 
Elfficicncy of prediction, 192 
Empirical mode, 87 
( (epsilon). Symbol for Standard 
error 

Elqually noticed differences, 392 
Equation, of line of beet fit, 244; of 
multiple r^pession, 301; of par- 
tial regression, 301 ; of regression, 
239; of straight line, 237 
Equivalent, measures, 246, 405; 
score equations, 246; scores, 246, 
406 

Ekror, in average, 9; in critenon, 
364; in difference, 350; in matched 
groups, 342; in power, 10; m 
product, 10; in quotient, 10; in 
root, 10; in sum, 9; of estimate, 
363; of mean square, 326; of 
naeasurement, 326, 366; of pr^o- 


tion, 192, 368; oi sampUng, 326; 
of score, 326, 366 
Errors, 7, 326 

Estimating, coefficients of oonel»- 
tion, 180; true scores, 248 
t) (eta) Symbol for Ratio of correla- 
tion 

Expenmentai coefficient, 355 


/ Symbol for Frequency. 

False accuracy, 12 
First quartile, 105 
Fluctuation, 115 
Footnile formula, 226 
Fourfold table, 309 
Frequency, 17; curve, 39; distribu- 
tion, 17, polygon, 37, 422; tabu- 
lation, 17 

Functions of the coefficient of cor- 
relation, 149, 188 


O Symbol for Geometric mean. 
g Symbol for Gain in rank. 
g Symbol for Error in prediction. 
Gain in rank, 226 

Gaussian curve See Normal fre- 
quency curve 

General statistical suggestions, 3 

Geometric mean, 91, 97, 102 

GM. Symbol for Geometnc mean. 

Cjoodness of fit, 386 

Graphs, 32, 416 

Group, 18 

Grouped senes, 17 

Group error, 336 

Grouping, 14, 18 

Guessed mean, 69 


H Symibol for Hannonie mean. 
h Symbol far Hei^t of normal fre- 
quency curve. 

Hannomc mean, 93, 102 
Height of normal frequency curve, 
439 

Htotogram, 34, 41, 422 

ffM. (Symfiof /or Harmonic mean. 
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/. StfnMfar Index of predieticm. 
i. Symbol for Interval. 

Inadequacy of data, 4 
Index, of correlation, 257; of mul- 
tiide correlation, of predie- 
tira, 193; of reliability, 215 
Individual error, 56, 336 
00 (infinity). Symbol for True 
score. 

Inspeetional mode, 87 
Intercept, 237 
Interconelation, 173 
Interpretation, of erron, 344; of 
measures of correlation, 148, 188, 
277, 290 

Interval, 10, 73, 80 
Inverse correlation, 144 
Iteration method of computing co- 
efficient of multiple correlation, 
289 


J-eurve, 63 


k. Symbol for Coefficient of aliena- 
tion. 

k. Symbol far Constant. 

I*. Symbol for Coefficient of non- 
determination. 

Kelley’s measure of skewness, 400 
Ku. Symbol for KurtoeiB. 

Kurtoeis, 60, 400 


L. Symbol for Fa cent of caaes bav- 
hig like signs. 

2. Symbol /or Lower limit. 
Leptokurtio dMribution, 60, 401 
liMar. See BeotOinear. ^ 
lineality crHerion, 254 
linear r e g r e ssi o n. ^ BeetOinear 
idation^p. 

Linear rdattoaship. Sac BeetOinear 
reiationahip. 
lines of “best fit," 244 
S. SymM /or Lower limit. 

Lower hmit, 19 
Lower quartde, 106 


M. Symbol /or Mean, 
m. Symbol for Multiplier In nwan 
difference method, 
m. Symbol far Slope. 

Afff. Symbol for (ieometrie mean. 
Major mode, 91 
Map graph, 433 
Maximum ordinate, 57, 382 
M D. Symbol for Mean deviation. 
Md Symbol for Median. 

MdD. Synd)olfor Median deviation. 
Mdn. Symbol for Median. 

Mean, 67, 97, 98 

Mean deviation, 119, 132, 136, 184 
Mean difference metiiod, 138 
Mean-equarc deviation, 123 
Mean-square error, 326 
Measurement of change, 404 
Measures of central tendency, 66 
Med. Symbol for Median. 

Median, 77, 98 

Median deviation, 58, 132, 137, 439 

Mesokurtic distribution, 60, 401 

Mid-measure, 77, 86, 98 

Mid-pomt, 20, 75 

Mid-score, 77, 86, 98 

Mmor mode, 91 

Mo. Symbol for Mode. 

Mode, 87, 08 
Moving average, 42 
Multi-modal distribution, 90 
Multiple, correlation, 2^; coeffi- 
cient of, 283; regression, 296 


bf. Symbol for Total number of 
cases. 

n. Symbol for Total number of cases, 
n. Symbol for Number of vsiiablee. 
No. Symbol for Number in elasses 
above. 

Ift. SymbU for Number in rlansns 
bdow. 

Nm. i^ymbol/or Number in mean or 
meAp class. 

Napifi^ iogarithnue base, 67 
Ne^ mr grouping data, 16 
Negative corrdation, 144 
Negative skewness, 63, 899 
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N«t MgKMioa, 296 
Nonwgruns, 7 
Nomographs, 7 
Non-ltoear. S«e Curvilinear. 
Non-qrminetrical curves, 62 
Normal curve, 53, 132, 378, 436 
Normal frequency curve, 53, 132, 
378, 439 

Normal probability curve, 53, 132, 
878, 439 

Number, in claeees above, 120; m 
classes below, 120; m mean or 
median class, 120; of classes, 21 
Numerical classification. See Van- 
able. 


O. Symbol for Origin. 

Ogive, 48 

u (omega). Symbol for CoefiScient of 
colligation. 

Order of coefficients of correlation, 
263 

Ordered ebaractenstic, 14, 33 
Ordinate, 33 
Origin, 32 
Overlapping, 401 

P See Goodness of fit. 

P. Symbol /or Percentile. 

p See Bi-senal coefficient of cxare- 
lation, errors. 

p. SymbUfor Numerator of product- 
moment correlation formula. 

Part correlation, 272 
Partial correlation coefficient, 263 
Partial correlation ratio, 281 
Partial multiple correlation, 294 
Partial regression, 296 
Partial standard deviation, 297 
Partial sum, 80 
Path coefficient, 276 
PB. Symbol /or Probable error. 
PBweu Symbol /or Pndiable error of 
esimate. / * 

PBmmi. Symbol far Prohiflilp ennr 
of measiveineat. 

PBt-». Symbol for Probable error 


PjBi.a. Symbol for Probable CRcr of 
estimate. 

Pearson’s coefficient of oimtingmiey, 
314 

Pearson’s coeme r (pi) method of 
correlation, 312 
Per. Symbol for Percentile. 
Percentile, 50, 109; curve, 48; 
graph, 48; method of equating 
scores, 409; rank, 109; score, 109 
Per cent, of cases having like signs, 
314; of cases having unlike signs, 
314 

Perfect correlation, 144 
Performance scale, 76 

(pbi). See Coefficient of contin- 
gency 

*■ (pi). Symbol for 3.1416—. 

Pie graph, 427 
Planning statistical work, 4 
Platykurtic distnbution, 60, 401 
Pomt of inflection, 137 
Positive correlation, 144 
Positive skewness, 63, 397 
PR Symbf4 for Percentile rank. 
Probable error, 132, 326; of esti- 
mate, 363; of measurement, 366; 
of samiJing, 328 

Product moment, correlation for 
quahtative senes, 320; correlation 
of fourfold table, 310; method of 
oorreiation, 151 
Product scale, 76 

PKudo-oontinuous distnbution, 28 
Pure guess, 194 
Purpose of book, 3 
Pyramid graph, 427 


Q. Syaibof/orOoeffieientof asMMi»> 
tion. 

Q. Symbol for Quartilc deviathm. 

g. Sie Bi-aoial ooeffieieiit of oom- 
lation, em»s. 

Qi. Symbol for First quartile. 

Qi. Symbol for ‘Diird quartile. 

Quadmot, 33 

Qualitative d aaaifi e ation. 8m JOIf- 
tzibote. 
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QuantitatiTe daanfieation. See 
Vanabie. 

QuaitUe, 105; deviation, 117, 132, 
136; range, 118 
Quintde, 113 


R. Sj/tiAoi for CoeflScient of mul- 
tiple correlation. 

R Symbol for CoeflScient of rank 
conation. 

R. Sy?nbol for Rank, 
r. Syiniof /or Coefficient of correla- 
tion 

r*. Symbol for CoeflScient of deter- 
mination 
Range, 116, 136 
Rank correlation, 224 
Ranking, 224 
Ranks, 111 
Rates of increase, 92 
Ratio, of correlation, 250, 324; of 
multiple correlation, 293; of par- 
tial correlation, 281; method of 
equating scores, 407; score, 407 
Reciprocals, 93 
Reetengular distnbution, 62 
Rectilinear correlation. See Recti- 
bnear relationship. 

Reetihnear relationship, 147, 263 
Regression, 237; coefficient, 240; 

equation, 239; Ime, 239 
Relation of length of test to relia- 
bility, 210 

Relative accuracy, 8 
Reliability, 66, 3^, 373, 395; co- 
efficient; 208; mdex, 215; of 

p (ifao)^ Coefioient of 

rank corrdatMT 

p (iho). Symbol for Index .df coire^ 

latlOn. ' 

Roffing avera(^ 42 
Boot-mean-equare deviation, 123 


8. See Coefficifflit of ocaitingenqy*) ' 
S. SynAd for Comparaldo ■corei' 
8. Stimbol /or Paitial sum. 


S'. Symbol for Summation of 
squares from assumed mean. 
Samphng, 338; error, 326 
Scatter, 115 

SD. Symhol /or Standard deviation. 
Second degree equation, 148 
Second quartile, 105 
Semi-interquartile range, 117 
Semi-parti^ correlation, 274 
Sheppard's method of unlike signs, 
314 

Short method of computing mean, 71 
Shrmkage in coefficient of multiple 
correlation, 292 

S (sigma) Symbol for Summation 
o (sigma) Symbol for Standard de- 
viation 

o (sigma) Symbol for Standard 
error 

Ottt Symbol for Standard error of 
estimate. 

Cnna Symfiol /oT Standard BiTor of 
measurement. 

0 \. m Symbol for Standard error of 
measurement 

<fi I Symbol for Standard error of 
estimate. 

o. Symbol for Standard error of 
sampling 

a* Symbol for Variance 
o score, 406 

SigmBcance, of a difilerencc, 350; of 
a coefficient of correlation, 149, 
188, 358 

Sigmficant figure, 8 
Sk Symbol for Skewness. 

Skew curve, 62 
Skewness, 62, 397 
Slide rules, 6 
Slope, 237 

Smooth frequency curve, 39, 422 
Smoothed curve, 43 
Smoothing, 42^. . 

Social n^iificBi|||s, 361 
SpeannHli-Browii formula, 2G0 
Spread, >15 

Spurious correlation, 206 
Standard deviation, 57, 98, 123, iSt, 
137, 439; of two or vatoe fomu, 128 
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Standard error, 326; of estimate, 
363; of measurement, 366; of 
sampling, 326 
Standwd score, 406 
Statistical aids, 5 
Step, 18 

Straight line relationship, 147, 263 
Symtelism, 7 

Symmetrical, curves, 63, 60 
Symmetrical distribution withm a 
class, 24 

Systematic error, 336 


T See Coefficient of contingency. 
Table of double entry, 162 
Tables for use in computing, 5 
Tabulating machines, 6 
Tabulation, 14 

10- 90 percentile range, 1 19, 132, 136 
Ter Symbol for Tertile 
Terminology, 7 
Tertile, 113 

Tetrachonc correlation, 311 
Theoretical mode, 88, 366 
Tlieoretlcally true score, 248 
Thermometer graph, 429 
Third quartile, 105 
Thomdiko’s coefiicient of variabil- 
ity, 141 
Time rates, 93 
Total number of cases, 17 
Total range, 1 16 
True mode, 88 
True score, 248, 366 
T-score, 391, 407 


V. Symbol for Per cent of cases 
having unlike signs 
u. SyrrAol for Upper lunit. 

U-curve, 62 

vi. /or Upper limit. 

Unbiased error, ^ / 

Unl-modal distributllin, 90 
Unit, of tinoe, 93; of vrark,4IB 
Unlike signs method of condation, 
314 

Unlimited dass, 25 


Unordered characteristic, 14 
Unretiabiiity. See Reliability. 
Upper hunt, 19 
Upper quartile, 105 
Use, of averages, 98; of measures of 
error, 349; of measures of validity, 
132; of normal frequency curve, 
378 


V Symbol for Coefficient of vari- 
ability. 

Variability, 66, 115 
Variable, 14, 33 
Variable error, 56, 336 
Variance, 131, 360 
Variation, 66, 115 

Verbal classification See Attribute. 


W Symbol for Weight. 

■Weighting mdependent vanablea, 
305 

Width of class, 19, 24 


X Symbol for Variable. 

X Symbol for Deviation of variable. 
X-axis, 32 


y. Symbol for Vanable. 
y Symbol for Deviation of vanaMe. 
y Symbol for Ordinate or height of 
curve 

yo. Symbol for Maximum ordinate. 
K-axis, 32 

Yule’s, coefficiet^ oC^soeiation, 
812; 812; 
ooemoteot onHw^gency, 315 


Z. Symboljor Mode. 

Z. Symbol for Stmidaid score, 
s. Symbol for Standard score devia- 
tion. 

0 iMZOk SynUwl for Critmion. 

HI, 374 

'f^Sta)i: r*. 


( 1 ) 



